00000001:02000400:0.0F:1787841503.302057:0:2951:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg101-server.virtnet: executing set_hostid 00000001:02000400:1.0F:1787841519.961500:0:3174:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg101-server.virtnet: executing load_modules_local 00000001:01000000:2.0F:1787841522.581072:0:3237:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 399 MB/s 00000001:01000000:1.0:1787841522.830997:0:3237:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 747 MB/s 00000001:01000000:2.0:1787841523.080882:0:3237:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 5323 MB/s 00000020:02000000:2.0:1787841524.094300:0:3267:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_95_g5b39979 00000400:02000000:0.0:1787841525.201649:0:3282:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.201.101@tcp [8/256/0/180] 00008000:02000000:0.0:1787841530.336374:0:3432:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0F:1787841594.286617:0:5241:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg101-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1787841606.100107:0:5819:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787841606.100115:0:5819:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1787841606.100283:0:5819:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000a1b486f1 00000080:02000400:1.0:1787841606.100296:0:5819:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:1.0:1787841606.107809:0:5819:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:1.0:1787841606.107827:0:5819:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1787841606.107869:0:5819:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000001abea4ea) 00000020:00000080:1.0:1787841606.107891:0:5819:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787841606.129368:0:5819:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1787841606.129790:0:5819:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1787841606.168840:0:5819:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1787841606.168882:0:5819:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787841606.168896:0:5819:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1787841606.168986:0:5819:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787841606.169001:0:5819:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1787841606.169423:0:5819:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1787841606.169432:0:5819:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787841606.169738:0:5819:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe3dac0c99affdf7a 00000020:01000004:2.0:1787841606.169747:0:5819:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1787841606.169753:0:5819:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1787841606.169759:0:5819:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000a1b486f1 from MGS 00000020:01000004:2.0:1787841606.169764:0:5819:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1787841606.169783:0:5819:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000f841470f) 00000020:00000080:2.0:1787841606.169796:0:5819:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1787841606.169861:0:5819:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000a1b486f1 from MGS, refs=2 00080000:01000000:2.0:1787841606.169867:0:5819:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787841606.169876:0:5819:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe3dac0c99affdf88 00000100:00100000:2.0:1787841606.170076:0:5819:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1787841606.170351:0:5819:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1787841606.170358:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1787841606.171265:0:5819:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1787841606.171274:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1787841606.172165:0:5819:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787841606.172350:0:5819:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1787841606.172354:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1787841606.172824:0:5819:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1787841606.172831:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1787841606.173096:0:5819:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1787841606.173100:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1787841606.174375:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841606.174379:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841606.174380:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841606.174590:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841606.174595:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841606.174596:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841606.175034:0:5819:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1787841606.179803:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1787841606.427137:0:5819:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 3952 MB/s 00000001:01000000:2.0:1787841606.678641:0:5819:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3828 MB/s 00000001:01000000:2.0:1787841606.928320:0:5819:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 843 MB/s 00000001:01000000:2.0:1787841607.179376:0:5819:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 713 MB/s 00080000:10000000:2.0:1787841607.192906:0:5819:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:3.0:1787841607.226067:0:5819:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1787841607.226097:0:5819:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787841607.226101:0:5819:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1787841607.230271:0:5829:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1787841607.230378:0:5819:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1787841607.230470:0:5819:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:0.0:1787841607.230903:0:5819:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1787841607.230939:0:5819:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1787841607.231359:0:5819:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787841607.231545:0:5819:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1787841607.231551:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1787841607.232860:0:5819:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1787841607.232871:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1787841607.233438:0:5819:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1787841607.233445:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00010000:00010000:3.0:1787841607.233980:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787841607.237376:0:5819:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1787841607.237407:0:5819:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.101@tcp' 00000020:01000004:3.0:1787841607.237410:0:5819:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1787841607.237468:0:5819:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.101@tcp (typ=mgc) 00000020:00000080:3.0:1787841607.237503:0:5819:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.101@tcp (00000000145ca083) 00000020:00000080:3.0:1787841607.237523:0:5819:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1787841607.237677:0:5819:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000014393ed6@MGC192.168.201.101@tcp: add connection 192.168.201.101@tcp at head 00010000:00010000:3.0:1787841607.237908:0:5819:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.101@tcp-0 is initialized 00000040:01000000:3.0:1787841607.237915:0:5819:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.101@tcp ctxt 1 is initialized 00000100:00080000:1.0:1787841607.240944:0:5834:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1787841607.247684:0:5836:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1787841607.247871:0:5819:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.101@tcp (uuid f6e7591a-84a0-4774-9d28-b3ed28591dc5) 00000020:00000080:1.0:1787841607.247898:0:5819:0:(genops.c:1385:class_connect()) connect: client f6e7591a-84a0-4774-9d28-b3ed28591dc5, cookie 0xe3dac0c99affdf96 00000100:00080000:1.0:1787841607.247910:0:5819:0:(import.c:510:import_select_connection()) MGC192.168.201.101@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787841607.247915:0:5819:0:(import.c:624:import_select_connection()) MGC192.168.201.101@tcp: import 0000000014393ed6 using connection 192.168.201.101@tcp/0@lo 00000100:00100000:1.0:1787841607.247950:0:5819:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000009eac637b x1874687714918528/t0(0) o250->MGC192.168.201.101@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787841607.247980:0:5819:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import f6e7591a-84a0-4774-9d28-b3ed28591dc5->MGS 00000020:01000004:1.0:1787841607.248003:0:5819:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1787841607.248028:0:5819:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1787841607.248041:0:5819:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000dbb14b95) 00000020:00000080:1.0:1787841607.248054:0:5819:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1787841607.248276:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009eac637b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3297:1874687714918528:0@lo:250: 00000100:00100000:0.0:1787841607.248357:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841607.248425:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714918528 00000100:00100000:0.0:1787841607.248433:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714918528 00000100:00100000:0.0:1787841607.248473:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787841607.248480:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000006eb8e9e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3297:x1874687714918528:12345-0@lo:250: 00010000:00080000:0.0:1787841607.248515:0:5831:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from f6e7591a-84a0-4774-9d28-b3ed28591dc5@0@lo t0 exp 0000000000000000 cur 147 last 0 00000020:00000080:0.0:1787841607.248537:0:5831:0:(genops.c:1385:class_connect()) connect: client f6e7591a-84a0-4774-9d28-b3ed28591dc5, cookie 0xe3dac0c99affdfa4 00000100:00080000:0.0:1787841607.248692:0:5831:0:(import.c:65:import_set_state_nolock()) 000000007e2373f2 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787841607.248771:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000006eb8e9e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+5:3297:x1874687714918528:12345-0@lo:250: Request processed in 291us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841607.248779:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787841607.248825:0:3297:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.201.101@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1787841607.248833:0:3297:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.101@tcp: connect to target with instance 0 00000100:00080000:0.0:1787841607.248841:0:3297:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.101@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1787841607.248845:0:3297:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1787841607.248848:0:3297:0:(import.c:65:import_set_state_nolock()) 0000000014393ed6 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1787841607.248851:0:3297:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1787841607.248858:0:3297:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1787841607.248870:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009eac637b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3297:1874687714918528:0@lo:250: 00000100:00100000:1.0:1787841607.269239:0:5819:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787841607.271017:0:5819:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1787841607.271044:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1787841607.272354:0:5819:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1787841607.272367:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1787841607.273348:0:5819:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1787841607.273357:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1787841607.280968:0:5819:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787841607.281503:0:5819:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1787841607.281512:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1787841607.282308:0:5819:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1787841607.282318:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1787841607.335489:0:5819:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787841607.337248:0:5819:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1787841607.337262:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1787841607.340986:0:5819:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1787841607.341000:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1787841607.346665:0:5819:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787841607.346947:0:5819:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787841607.346954:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1787841607.348128:0:5819:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787841607.348137:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1787841607.348907:0:5819:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787841607.349073:0:5819:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787841607.349079:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1787841607.350079:0:5819:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787841607.350089:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1787841607.353281:0:5819:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787841607.353480:0:5819:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787841607.353488:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1787841607.355291:0:5819:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787841607.355303:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1787841607.385746:0:5819:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787841607.388454:0:5819:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1787841607.388490:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1787841607.395087:0:5819:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787841607.395116:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1787841607.398478:0:5819:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787841607.398560:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1787841607.404341:0:5819:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1787841607.404375:0:5819:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1787841607.404384:0:5819:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.101@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1787841607.404547:0:5819:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.101@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787841607.404583:0:5819:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.101@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1787841607.404588:0:5819:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787841607.404589:0:5819:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787841607.404590:0:5819:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787841607.404591:0:5819:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787841607.404593:0:5819:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787841607.404594:0:5819:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787841607.404595:0:5819:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787841607.404597:0:5819:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787841607.404598:0:5819:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787841607.404600:0:5819:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787841607.404602:0:5819:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787841607.404603:0:5819:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787841607.404606:0:5819:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1787841607.404608:0:5819:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787841607.404609:0:5819:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787841607.404610:0:5819:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787841607.404611:0:5819:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787841607.404612:0:5819:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787841607.404613:0:5819:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787841607.404614:0:5819:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787841607.404615:0:5819:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787841607.404616:0:5819:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787841607.404621:0:5819:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787841607.404622:0:5819:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787841607.404623:0:5819:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787841607.404652:0:5819:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787841607.404670:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000280366ef pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5819:1874687714918656:0@lo:253: 00000100:00100000:2.0:1787841607.404811:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841607.404867:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f9e56391 going to sleep for 11 seconds 00000100:00100000:1.0:1787841607.405990:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714918656 00000100:00100000:1.0:1787841607.406001:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714918656 00000100:00100000:1.0:1787841607.406055:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787841607.406064:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000344f3e39 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+5:5819:x1874687714918656:12345-0@lo:253: 20000000:01000000:1.0:1787841607.406128:0:5833:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787841607.406131:0:5833:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:0.0:1787841607.408029:0:5853:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1787841607.408125:0:5833:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1787841607.408517:0:5833:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787841607.409447:0:5854:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1787841607.411453:0:5833:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787841607.411459:0:5833:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1787841607.411465:0:5833:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1787841607.411469:0:5833:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1787841607.411482:0:5833:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1787841607.411773:0:5833:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787841607.411984:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1787841607.411995:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787841607.412028:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1787841607.412052:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1787841607.412071:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1787841607.412152:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1787841607.412169:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1787841607.412231:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1787841607.412240:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1787841607.412272:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1787841607.412279:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1787841607.412313:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1787841607.412359:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1787841607.412388:0:5833:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1787841607.412393:0:5833:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1787841607.412402:0:5833:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787841607.412588:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1787841607.412597:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1787841607.412628:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1787841607.412652:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1787841607.412685:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1787841607.412694:0:5833:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1787841607.412804:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1787841607.412813:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1787841607.412864:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1787841607.412899:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1787841607.412937:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1787841607.412946:0:5833:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1787841607.413023:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1787841607.413032:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1787841607.413057:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1787841607.413075:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:1.0:1787841607.413217:0:5833:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1787841607.413260:0:5833:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1787841607.413267:0:5833:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:1.0:1787841607.413967:0:5855:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:2.0:1787841607.414284:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:2.0:1787841607.414307:0:5833:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.201.101@tcp for mdt 20000000:01000000:2.0:1787841607.414309:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.101@tcp (null) (null) (null) 00000040:00080000:2.0:1787841607.414345:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:2.0:1787841607.414352:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1787841607.414383:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1787841607.414389:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.201.101@tcp (null) (null) 00000040:00080000:2.0:1787841607.414455:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:2.0:1787841607.414467:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1787841607.414500:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1787841607.414537:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1787841607.414595:0:5833:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:2.0:1787841607.414598:0:5833:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1787841607.414602:0:5833:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1787841607.414614:0:5833:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787841607.414617:0:5833:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1787841607.414644:0:5833:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1787841607.414646:0:5833:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1787841607.415773:0:5856:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:2.0:1787841607.416029:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1787841607.416061:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:2.0:1787841607.416128:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:2.0:1787841607.416139:0:5833:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787841607.416141:0:5833:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787841607.416684:0:5857:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1787841607.416984:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1787841607.417046:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1787841607.417089:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:2.0:1787841607.417101:0:5833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787841607.417103:0:5833:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:2.0:1787841607.417123:0:5833:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1787841607.417126:0:5833:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1787841607.417132:0:5833:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1787841607.417139:0:5833:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1787841607.417799:0:5858:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:1.0:1787841607.417929:0:5833:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:1.0:1787841607.426105:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:1.0:1787841607.426270:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:1.0:1787841607.426346:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:1.0:1787841607.426372:0:5833:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1787841607.426397:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000007fff31c5/0xe3dac0c99affdfab lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841607.426414:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007fff31c5/0xe3dac0c99affdfab lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841607.426424:0:5833:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000007fff31c5/0xe3dac0c99affdfab lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841607.426430:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000007fff31c5/0xe3dac0c99affdfab lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841607.426436:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000007fff31c5/0xe3dac0c99affdfab lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841607.426442:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000007fff31c5/0xe3dac0c99affdfab lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841607.426449:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000007fff31c5 already unused, calling callback (000000004b9b3d27) 00010000:00010000:1.0:1787841607.426452:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000007fff31c5/0xe3dac0c99affdfab lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841607.426459:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000007fff31c5/0xe3dac0c99affdfab lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841607.426471:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000007fff31c5/0xe3dac0c99affdfab lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841607.426502:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000007fff31c5/0xe3dac0c99affdfab lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841607.426507:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000007fff31c5/0xe3dac0c99affdfab lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787841607.426527:0:5833:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1787841607.660582:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000344f3e39 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+5:5819:x1874687714918656:12345-0@lo:253: Request processed in 254510us (255764us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841607.660601:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787841607.660751:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000280366ef pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5819:1874687714918656:0@lo:253: 10000000:01000000:2.0:1787841607.660767:0:5819:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787841607.660769:0:5819:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787841607.660771:0:5819:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787841607.660772:0:5819:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787841607.660773:0:5819:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1787841607.660774:0:5819:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787841607.660776:0:5819:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787841607.660777:0:5819:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787841607.660778:0:5819:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787841607.660780:0:5819:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1787841607.660782:0:5819:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787841607.660783:0:5819:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787841607.660810:0:5819:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000a1b486f1 from lustre-MDT0000 10000000:01000000:2.0:1787841607.660840:0:5819:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1787841607.660844:0:5819:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787841607.660849:0:5819:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff92cbe9a69a48 10000000:01000000:2.0:1787841607.660854:0:5819:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787841607.660861:0:5819:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff92cbe9a69a48 from 1 10000000:01000000:2.0:1787841607.660864:0:5819:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787841607.661116:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: 0000000015e2fd2d/0xe3dac0c99affdfb2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841607.661128:0:5819:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: 0000000015e2fd2d/0xe3dac0c99affdfb2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841607.661138:0:5819:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: 0000000015e2fd2d/0xe3dac0c99affdfb2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841607.661229:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000280366ef pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5819:1874687714918784:0@lo:101: 00000100:00100000:3.0:1787841607.661304:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841607.661403:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set 000000002605fa15 going to sleep for 11 seconds 00000100:00100000:1.0:1787841607.661538:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714918784 00000100:00100000:1.0:1787841607.661546:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714918784 00000100:00100000:1.0:1787841607.661639:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787841607.661649:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000428bc211 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+5:5819:x1874687714918784:12345-0@lo:101: 00010000:00010000:1.0:1787841607.661667:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841607.661689:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007fff31c5/0xe3dac0c99affdfb9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe3dac0c99affdfb2 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841607.661734:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007fff31c5/0xe3dac0c99affdfb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe3dac0c99affdfb2 expref: 6 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841607.661746:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007fff31c5/0xe3dac0c99affdfb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe3dac0c99affdfb2 expref: 6 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841607.661756:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007fff31c5, rc 0) 00000100:00100000:1.0:1787841607.661800:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000428bc211 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+6:5819:x1874687714918784:12345-0@lo:101: Request processed in 153us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841607.661807:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787841607.661898:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000280366ef pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5819:1874687714918784:0@lo:101: 00010000:00010000:3.0:1787841607.661913:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: 0000000015e2fd2d/0xe3dac0c99affdfb2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affdfb9 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841607.661921:0:5819:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: 0000000015e2fd2d/0xe3dac0c99affdfb2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe3dac0c99affdfb9 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841607.661979:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002113a10a pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5819:1874687714918912:0@lo:501: 00000100:00100000:3.0:1787841607.662007:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841607.664451:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set 000000002605fa15 going to sleep for 11 seconds 00000100:00100000:2.0:1787841607.664545:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714918912 00000100:00100000:2.0:1787841607.664555:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714918912 00000100:00100000:0.0:1787841607.664766:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787841607.664776:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000020aa641a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+6:5819:x1874687714918912:12345-0@lo:501: 00000100:00100000:0.0:1787841607.665398:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000020aa641a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+6:5819:x1874687714918912:12345-0@lo:501: Request processed in 622us (3389us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787841607.665408:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787841607.665505:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002113a10a pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5819:1874687714918912:0@lo:501: 10000000:01000000:3.0:1787841607.665539:0:5819:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787841607.665606:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: 0000000015e2fd2d/0xe3dac0c99affdfb2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affdfb9 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841607.665617:0:5819:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: 0000000015e2fd2d/0xe3dac0c99affdfb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affdfb9 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787841607.665626:0:5819:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff92cbc3ed8000 10000000:01000000:3.0:1787841607.665632:0:5819:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787841607.665637:0:5819:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff92cbc3ed8000 10000000:01000000:3.0:1787841607.665640:0:5819:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1787841607.665643:0:5819:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff92cbc3ed8000 from 1 10000000:01000000:3.0:1787841607.665654:0:5819:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1787841607.665689:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: 000000006594b9eb/0xe3dac0c99affdfc0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841607.665719:0:5819:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: 000000006594b9eb/0xe3dac0c99affdfc0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841607.665729:0:5819:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: 000000006594b9eb/0xe3dac0c99affdfc0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841607.665750:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002113a10a pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5819:1874687714919040:0@lo:101: 00000100:00100000:3.0:1787841607.665788:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841607.665817:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set 000000002605fa15 going to sleep for 11 seconds 00000100:00100000:3.0:1787841607.665840:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714919040 00000100:00100000:3.0:1787841607.665845:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714919040 00000100:00100000:2.0:1787841607.665983:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787841607.665995:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008f0344c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+6:5819:x1874687714919040:12345-0@lo:101: 00010000:00010000:2.0:1787841607.666007:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841607.666027:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b3b2c69b/0xe3dac0c99affdfc7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe3dac0c99affdfc0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841607.666047:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b3b2c69b/0xe3dac0c99affdfc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe3dac0c99affdfc0 expref: 7 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841607.666057:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b3b2c69b/0xe3dac0c99affdfc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe3dac0c99affdfc0 expref: 7 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841607.666064:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b3b2c69b, rc 0) 00000100:00100000:2.0:1787841607.666097:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008f0344c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+7:5819:x1874687714919040:12345-0@lo:101: Request processed in 106us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841607.666103:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787841607.666287:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002113a10a pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5819:1874687714919040:0@lo:101: 00010000:00010000:3.0:1787841607.666299:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: 000000006594b9eb/0xe3dac0c99affdfc0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affdfc7 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841607.666306:0:5819:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: 000000006594b9eb/0xe3dac0c99affdfc0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe3dac0c99affdfc7 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787841607.666317:0:5819:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1787841607.667325:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: 000000006594b9eb/0xe3dac0c99affdfc0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affdfc7 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841607.667339:0:5819:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: 000000006594b9eb/0xe3dac0c99affdfc0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affdfc7 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787841607.667348:0:5819:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787841607.667369:0:5819:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787841607.667376:0:5819:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff92cbc3ed8000 10000000:01000000:3.0:1787841607.667378:0:5819:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1787841607.667382:0:5819:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1787841607.667385:0:5819:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787841607.667414:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: 00000000df6d90df/0xe3dac0c99affdfce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841607.667421:0:5819:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: 00000000df6d90df/0xe3dac0c99affdfce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841607.667429:0:5819:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: 00000000df6d90df/0xe3dac0c99affdfce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841607.667449:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002113a10a pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5819:1874687714919168:0@lo:101: 00000100:00100000:3.0:1787841607.667505:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841607.667584:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set 000000002605fa15 going to sleep for 11 seconds 00000100:00100000:2.0:1787841607.667658:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714919168 00000100:00100000:2.0:1787841607.667666:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714919168 00000100:00100000:3.0:1787841607.667874:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787841607.667955:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d6ca1a8c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+7:5819:x1874687714919168:12345-0@lo:101: 00010000:00010000:3.0:1787841607.667968:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841607.667983:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c95fddcb/0xe3dac0c99affdfd5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe3dac0c99affdfce expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841607.668006:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c95fddcb/0xe3dac0c99affdfd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe3dac0c99affdfce expref: 8 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841607.668016:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c95fddcb/0xe3dac0c99affdfd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe3dac0c99affdfce expref: 8 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841607.668024:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c95fddcb, rc 0) 00000100:00100000:3.0:1787841607.668135:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d6ca1a8c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+8:5819:x1874687714919168:12345-0@lo:101: Request processed in 253us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841607.668142:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787841607.668330:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002113a10a pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5819:1874687714919168:0@lo:101: 00010000:00010000:0.0:1787841607.668345:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: 00000000df6d90df/0xe3dac0c99affdfce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affdfd5 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841607.668353:0:5819:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: 00000000df6d90df/0xe3dac0c99affdfce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe3dac0c99affdfd5 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841607.668427:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d4ac5aba pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5819:1874687714919296:0@lo:501: 00000100:00100000:0.0:1787841607.668458:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841607.668529:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set 0000000091af922e going to sleep for 11 seconds 00000100:00100000:2.0:1787841607.668572:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714919296 00000100:00100000:2.0:1787841607.668577:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714919296 00000100:00100000:2.0:1787841607.668645:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787841607.668654:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000085f992e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+8:5819:x1874687714919296:12345-0@lo:501: 00000100:00100000:2.0:1787841607.669042:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000085f992e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+9:5819:x1874687714919296:12345-0@lo:501: Request processed in 389us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841607.669049:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787841607.669134:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d4ac5aba pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5819:1874687714919296:0@lo:501: 00000100:00100000:0.0:1787841607.669178:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d4ac5aba pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5819:1874687714919424:0@lo:503: 00000100:00100000:0.0:1787841607.669216:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841607.670631:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set 0000000091af922e going to sleep for 11 seconds 00000100:00100000:3.0:1787841607.670788:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714919424 00000100:00100000:3.0:1787841607.670798:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714919424 00000100:00100000:3.0:1787841607.670846:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787841607.670854:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006be8d720 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+9:5819:x1874687714919424:12345-0@lo:503: 00000100:00100000:3.0:1787841607.671098:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006be8d720 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+9:5819:x1874687714919424:12345-0@lo:503: Request processed in 245us (1881us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841607.671117:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787841607.671344:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d4ac5aba pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5819:1874687714919424:0@lo:503: 00000100:00100000:0.0:1787841607.672078:0:5861:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d4ac5aba pname:cluuid:pid:xid:nid:opc:job llog_process_th:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5861:1874687714919552:0@lo:502: 00000100:00100000:0.0:1787841607.672141:0:5861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841607.672263:0:5861:0:(client.c:2715:ptlrpc_set_wait()) set 0000000089f5b15c going to sleep for 11 seconds 00000100:00100000:3.0:1787841607.672304:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714919552 00000100:00100000:3.0:1787841607.672310:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714919552 00000100:00100000:3.0:1787841607.672382:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787841607.672389:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000023f3dcca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+9:5861:x1874687714919552:12345-0@lo:502: 00000100:00100000:3.0:1787841607.672621:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000023f3dcca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+9:5861:x1874687714919552:12345-0@lo:502: Request processed in 232us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841607.672629:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787841607.673257:0:5861:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d4ac5aba pname:cluuid:pid:xid:nid:opc:job llog_process_th:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5861:1874687714919552:0@lo:502: 00000020:01000000:0.0:1787841607.673290:0:5861:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787841607.673311:0:5861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787841607.673314:0:5861:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787841607.673319:0:5861:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1787841607.673324:0:5861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787841607.673347:0:5861:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (0000000046f7027f) 00000020:00000080:0.0:1787841607.673370:0:5861:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1787841607.673376:0:5861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1787841607.673455:0:5861:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:0.0:1787841607.673462:0:5861:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe3dac0c99affdfe3 00000020:00000080:0.0:1787841607.673679:0:5861:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1787841607.673683:0:5861:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787841607.673686:0:5861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787841607.673693:0:5861:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787841607.673719:0:5861:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787841607.673724:0:5861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787841607.673725:0:5861:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1787841607.673728:0:5861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787841607.673734:0:5861:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000003fa0718e) 00000020:00000080:0.0:1787841607.673744:0:5861:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1787841607.673748:0:5861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1787841607.673749:0:5861:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1787841607.673752:0:5861:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1787841607.673758:0:5861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787841607.673810:0:5861:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000a1b486f1 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1787841607.673821:0:5861:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000e4766199) 00000020:00000080:0.0:1787841607.673829:0:5861:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1787841607.673967:0:5861:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1787841607.673974:0:5861:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe3dac0c99affdff8 00000020:00000080:0.0:1787841607.674089:0:5861:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1787841607.674096:0:5861:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1787841607.674101:0:5861:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xe3dac0c99affdfff 00080000:01000000:0.0:1787841607.674119:0:5861:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:0.0:1787841607.674122:0:5861:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe3dac0c99affe006 00080000:10000000:0.0:1787841607.674801:0:5861:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:0.0:1787841607.675187:0:5861:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:0.0:1787841607.679340:0:5861:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1787841607.766012:0:5861:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1787841607.766368:0:5861:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1787841607.768746:0:5861:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1787841607.769031:0:5861:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1787841607.807074:0:5861:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000000fc75ce3) 00000020:00000080:3.0:1787841607.807100:0:5861:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1787841607.807187:0:5861:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:3.0:1787841607.807195:0:5861:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe3dac0c99affe014 00000020:00000080:3.0:1787841607.815746:0:5861:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1787841607.816906:0:5861:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:1.0:1787841607.859889:0:5861:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1787841607.922872:0:5861:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787841607.980916:0:5861:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787841608.034165:0:5861:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787841608.074791:0:5861:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:2.0:1787841608.104224:0:5861:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xe3dac0c99affe01b 00000020:00000080:3.0:1787841608.104605:0:5861:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1787841608.104617:0:5861:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787841608.104623:0:5861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787841608.104625:0:5861:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1787841608.104628:0:5861:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787841608.104631:0:5861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787841608.104639:0:5861:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787841608.104643:0:5861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787841608.104644:0:5861:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787841608.104647:0:5861:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787841608.104649:0:5861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787841608.104650:0:5861:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787841608.104652:0:5861:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787841608.104657:0:5861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787841608.104658:0:5861:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1787841608.104661:0:5861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1787841608.104714:0:5861:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:3.0:1787841608.104766:0:5861:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b1fadf27 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5861:1874687714919680:0@lo:502: 00000100:00100000:3.0:1787841608.104841:0:5861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841608.104991:0:5861:0:(client.c:2715:ptlrpc_set_wait()) set 000000003fb1d484 going to sleep for 11 seconds 00000100:00100000:0.0:1787841608.105198:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714919680 00000100:00100000:0.0:1787841608.105204:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714919680 00000100:00100000:0.0:1787841608.105276:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787841608.105284:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001ca644d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+9:5861:x1874687714919680:12345-0@lo:502: 00000100:00100000:0.0:1787841608.105653:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001ca644d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+9:5861:x1874687714919680:12345-0@lo:502: Request processed in 369us (811us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841608.105662:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787841608.105743:0:5861:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b1fadf27 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5861:1874687714919680:0@lo:502: 00000020:01000000:3.0:1787841608.105766:0:5861:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787841608.105770:0:5861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787841608.105772:0:5861:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:3.0:1787841608.105775:0:5861:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1787841608.105990:0:5819:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1787841608.106009:0:5819:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787841608.106090:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: 00000000df6d90df/0xe3dac0c99affdfce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affdfd5 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841608.106111:0:5819:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: 00000000df6d90df/0xe3dac0c99affdfce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affdfd5 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787841608.106119:0:5819:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff92cbc3ed8000 from 1 10000000:01000000:1.0:1787841608.106123:0:5819:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787841608.106153:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: 000000008da2c841/0xe3dac0c99affe022 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841608.106160:0:5819:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: 000000008da2c841/0xe3dac0c99affe022 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841608.106167:0:5819:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: 000000008da2c841/0xe3dac0c99affe022 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841608.106181:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002fe7d050 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5819:1874687714919808:0@lo:101: 00000100:00100000:1.0:1787841608.106216:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841608.106406:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set 0000000049c9b145 going to sleep for 11 seconds 00000100:00100000:2.0:1787841608.106443:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714919808 00000100:00100000:2.0:1787841608.106449:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714919808 00000100:00100000:0.0:1787841608.106491:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787841608.106507:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000c28d3f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+9:5819:x1874687714919808:12345-0@lo:101: 00010000:00010000:0.0:1787841608.106518:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841608.106530:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006504d9f7/0xe3dac0c99affe029 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe3dac0c99affe022 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841608.106550:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006504d9f7/0xe3dac0c99affe029 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe3dac0c99affe022 expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841608.106559:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006504d9f7/0xe3dac0c99affe029 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe3dac0c99affe022 expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841608.106567:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006504d9f7, rc 0) 00000100:00100000:0.0:1787841608.106605:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000c28d3f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+10:5819:x1874687714919808:12345-0@lo:101: Request processed in 99us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841608.106611:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787841608.106668:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002fe7d050 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5819:1874687714919808:0@lo:101: 00010000:00010000:1.0:1787841608.106681:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: 000000008da2c841/0xe3dac0c99affe022 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe029 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841608.106688:0:5819:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: 000000008da2c841/0xe3dac0c99affe022 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe3dac0c99affe029 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841608.107401:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002fe7d050 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5819:1874687714919936:0@lo:256: 00000100:00100000:1.0:1787841608.107447:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841608.107683:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set 0000000049c9b145 going to sleep for 11 seconds 00000100:00100000:3.0:1787841608.107779:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714919936 00000100:00100000:3.0:1787841608.107785:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714919936 00000100:00100000:3.0:1787841608.107810:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787841608.107816:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000078239bb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+10:5819:x1874687714919936:12345-0@lo:256: 20000000:01000000:3.0:1787841608.107832:0:5833:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1787841608.107838:0:5833:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1787841608.107909:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000078239bb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+10:5819:x1874687714919936:12345-0@lo:256: Request processed in 93us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841608.107916:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787841608.108064:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002fe7d050 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5819:1874687714919936:0@lo:256: 10000000:01000000:1.0:1787841608.108655:0:5819:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787841608.108680:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: 000000008da2c841/0xe3dac0c99affe022 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe029 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841608.108691:0:5819:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: 000000008da2c841/0xe3dac0c99affe022 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe029 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787841608.108732:0:5819:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92cbc3ed8000 from 1 10000000:01000000:1.0:1787841608.108735:0:5819:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787841608.108763:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: 00000000f3bff496/0xe3dac0c99affe030 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841608.108771:0:5819:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: 00000000f3bff496/0xe3dac0c99affe030 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841608.108779:0:5819:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: 00000000f3bff496/0xe3dac0c99affe030 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841608.108796:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002fe7d050 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5819:1874687714920064:0@lo:101: 00000100:00100000:1.0:1787841608.108840:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841608.108866:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set 0000000049c9b145 going to sleep for 11 seconds 00000100:00100000:3.0:1787841608.109148:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714920064 00000100:00100000:3.0:1787841608.109154:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714920064 00000100:00100000:3.0:1787841608.109193:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787841608.109199:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000adb7ecd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+10:5819:x1874687714920064:12345-0@lo:101: 00010000:00010000:3.0:1787841608.109211:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841608.109224:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007c984001/0xe3dac0c99affe037 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe3dac0c99affe030 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841608.109246:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007c984001/0xe3dac0c99affe037 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe3dac0c99affe030 expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841608.109255:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007c984001/0xe3dac0c99affe037 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe3dac0c99affe030 expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841608.109266:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007c984001, rc 0) 00000100:00100000:3.0:1787841608.109301:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000adb7ecd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+11:5819:x1874687714920064:12345-0@lo:101: Request processed in 102us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841608.109308:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787841608.109393:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002fe7d050 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5819:1874687714920064:0@lo:101: 00010000:00010000:1.0:1787841608.109408:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: 00000000f3bff496/0xe3dac0c99affe030 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe037 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841608.109421:0:5819:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: 00000000f3bff496/0xe3dac0c99affe030 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe3dac0c99affe037 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841608.109468:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002fe7d050 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5819:1874687714920192:0@lo:501: 00000100:00100000:1.0:1787841608.109507:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841608.109561:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set 0000000049c9b145 going to sleep for 11 seconds 00000100:00100000:2.0:1787841608.109858:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714920192 00000100:00100000:2.0:1787841608.109863:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714920192 00000100:00100000:1.0:1787841608.110526:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787841608.110536:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b8b6801f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+11:5819:x1874687714920192:12345-0@lo:501: 00000100:00100000:1.0:1787841608.111507:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b8b6801f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+11:5819:x1874687714920192:12345-0@lo:501: Request processed in 969us (2007us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841608.111518:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787841608.111775:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002fe7d050 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5819:1874687714920192:0@lo:501: 00000100:00100000:0.0:1787841608.111829:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d4ac5aba pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5819:1874687714920320:0@lo:503: 00000100:00100000:0.0:1787841608.111948:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841608.111985:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set 0000000017ee1538 going to sleep for 11 seconds 00000100:00100000:2.0:1787841608.112095:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714920320 00000100:00100000:2.0:1787841608.112110:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714920320 00000100:00100000:2.0:1787841608.112141:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787841608.112148:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000030e09236 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+11:5819:x1874687714920320:12345-0@lo:503: 00000040:00080000:2.0:1787841608.112188:0:5831:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787841608.112239:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000030e09236 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+11:5819:x1874687714920320:12345-0@lo:503: Request processed in 92us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841608.112248:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787841608.112323:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d4ac5aba pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5819:1874687714920320:0@lo:503: 00000040:00080000:1.0:1787841608.113441:0:5865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:0.0:1787841608.113746:0:5819:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1787841608.113768:0:5819:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787841608.113791:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: 00000000f3bff496/0xe3dac0c99affe030 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe037 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841608.113806:0:5819:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: 00000000f3bff496/0xe3dac0c99affe030 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe037 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787841608.113871:0:5819:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787841608.113947:0:5819:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff92cbc3ed8000 10000000:01000000:0.0:1787841608.113951:0:5819:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff92cbc3ed8000 10000000:01000000:0.0:1787841608.113956:0:5819:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787841608.113962:0:5819:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff92cbc3ed8000 from 1 10000000:01000000:0.0:1787841608.113965:0:5819:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787841608.113997:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: 00000000c859b377/0xe3dac0c99affe03e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841608.114005:0:5819:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: 00000000c859b377/0xe3dac0c99affe03e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841608.114014:0:5819:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: 00000000c859b377/0xe3dac0c99affe03e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841608.114033:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d4ac5aba pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5819:1874687714920448:0@lo:101: 00000100:00100000:0.0:1787841608.114168:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841608.114209:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bc0cc60b going to sleep for 11 seconds 00000100:00100000:2.0:1787841608.114274:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714920448 00000100:00100000:2.0:1787841608.114282:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714920448 00000100:00100000:2.0:1787841608.114328:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787841608.114337:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a78412f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+11:5819:x1874687714920448:12345-0@lo:101: 00010000:00010000:2.0:1787841608.114350:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841608.114364:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000eb49020f/0xe3dac0c99affe045 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe3dac0c99affe03e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841608.114386:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000eb49020f/0xe3dac0c99affe045 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe3dac0c99affe03e expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841608.114395:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000eb49020f/0xe3dac0c99affe045 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe3dac0c99affe03e expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841608.114403:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000eb49020f, rc 0) 00000100:00100000:2.0:1787841608.114438:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a78412f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+12:5819:x1874687714920448:12345-0@lo:101: Request processed in 103us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841608.114455:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787841608.114659:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d4ac5aba pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5819:1874687714920448:0@lo:101: 00010000:00010000:0.0:1787841608.114673:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: 00000000c859b377/0xe3dac0c99affe03e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe045 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841608.114682:0:5819:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: 00000000c859b377/0xe3dac0c99affe03e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe3dac0c99affe045 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841608.114747:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d4ac5aba pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5819:1874687714920576:0@lo:501: 00000100:00100000:0.0:1787841608.114774:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841608.114795:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bc0cc60b going to sleep for 11 seconds 00000100:00100000:3.0:1787841608.115109:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714920576 00000100:00100000:3.0:1787841608.115114:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714920576 00000100:00100000:3.0:1787841608.115147:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787841608.115153:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f1d0b056 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+12:5819:x1874687714920576:12345-0@lo:501: 00000100:00100000:3.0:1787841608.115402:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f1d0b056 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+12:5819:x1874687714920576:12345-0@lo:501: Request processed in 249us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841608.115411:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787841608.115480:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d4ac5aba pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5819:1874687714920576:0@lo:501: 00000100:00100000:1.0:1787841608.115511:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000b8b5d6c pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5819:1874687714920704:0@lo:503: 00000100:00100000:1.0:1787841608.115551:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841608.115587:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set 00000000edbb039c going to sleep for 11 seconds 00000100:00100000:3.0:1787841608.115720:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714920704 00000100:00100000:3.0:1787841608.115725:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714920704 00000100:00100000:3.0:1787841608.115745:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787841608.115750:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cbbba9de pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+12:5819:x1874687714920704:12345-0@lo:503: 00000100:00100000:3.0:1787841608.116201:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cbbba9de pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+12:5819:x1874687714920704:12345-0@lo:503: Request processed in 449us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841608.116215:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787841608.116307:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000b8b5d6c pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5819:1874687714920704:0@lo:503: 00000100:00100000:0.0:1787841608.116677:0:5866:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d81f1389 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5866:1874687714920832:0@lo:502: 00000100:00100000:0.0:1787841608.116743:0:5866:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841608.116767:0:5866:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bc0cc60b going to sleep for 11 seconds 00000100:00100000:3.0:1787841608.116824:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714920832 00000100:00100000:3.0:1787841608.116829:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714920832 00000100:00100000:3.0:1787841608.116860:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787841608.116866:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004ca2878f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+12:5866:x1874687714920832:12345-0@lo:502: 00000100:00100000:3.0:1787841608.117205:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004ca2878f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+12:5866:x1874687714920832:12345-0@lo:502: Request processed in 339us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841608.117213:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787841608.117350:0:5866:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d81f1389 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5866:1874687714920832:0@lo:502: 00000020:01000004:1.0:1787841608.117409:0:5866:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1787841608.117426:0:5866:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000c9f41bde) 00000020:00000080:1.0:1787841608.117445:0:5866:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:1.0:1787841608.117533:0:5866:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000a1b486f1 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1787841608.117537:0:5866:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000a1b486f1 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1787841608.117540:0:5866:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000a1b486f1 4 00010000:00080000:1.0:1787841608.117572:0:5866:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000041b14861@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.101@tcp at head 00010000:00010000:1.0:1787841608.120189:0:5866:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:1.0:1787841608.120435:0:5866:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1787841608.120474:0:5866:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787841608.120488:0:5866:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xe3dac0c99affe053 00000100:00080000:1.0:1787841608.120499:0:5866:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787841608.120505:0:5866:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000041b14861 using connection 192.168.201.101@tcp/0@lo 00000100:00100000:1.0:1787841608.120546:0:5866:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000000b8b5d6c x1874687714920960/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787841608.120578:0:5866:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787841608.120955:0:5866:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b1fadf27 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5866:1874687714921088:0@lo:502: 00000100:00100000:3.0:1787841608.121266:0:5866:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841608.121317:0:5866:0:(client.c:2715:ptlrpc_set_wait()) set 000000002314ff78 going to sleep for 11 seconds 00000100:00100000:1.0:1787841608.121367:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714921088 00000100:00100000:1.0:1787841608.121374:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714921088 00000100:00100000:1.0:1787841608.121426:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787841608.121435:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000030ec878c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+12:5866:x1874687714921088:12345-0@lo:502: 00000100:00100000:1.0:1787841608.121662:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000030ec878c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+12:5866:x1874687714921088:12345-0@lo:502: Request processed in 227us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841608.121669:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787841608.121803:0:5866:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b1fadf27 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5866:1874687714921088:0@lo:502: 00000040:00080000:3.0:1787841608.121834:0:5866:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000100:00100000:2.0:1787841608.122073:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000b8b5d6c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3297:1874687714920960:0@lo:38: 00000100:00100000:2.0:1787841608.122128:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841608.122277:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714920960 00000100:00100000:3.0:1787841608.122283:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714920960 00000100:00100000:3.0:1787841608.122311:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787841608.122316:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000280366ef pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3297:x1874687714920960:12345-0@lo:38: 00000100:00100000:3.0:1787841608.122372:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000280366ef pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3297:x1874687714920960:12345-0@lo:38: Request processed in 56us (245us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787841608.122379:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787841608.122436:0:3297:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787841608.122442:0:3297:0:(import.c:65:import_set_state_nolock()) 0000000041b14861 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787841608.122447:0:3297:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1787841608.122450:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000b8b5d6c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3297:1874687714920960:0@lo:38: 00000020:01000000:1.0:1787841608.125316:0:5819:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:1.0:1787841608.125354:0:5819:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787841608.125380:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: 00000000c859b377/0xe3dac0c99affe03e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe045 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841608.125393:0:5819:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: 00000000c859b377/0xe3dac0c99affe03e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe045 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787841608.125443:0:5819:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787841608.125445:0:5819:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787841608.125447:0:5819:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787841608.125448:0:5819:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787841608.125453:0:5819:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787841608.125454:0:5819:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787841608.125455:0:5819:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787841608.125456:0:5819:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787841608.125457:0:5819:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787841608.125459:0:5819:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787841608.125460:0:5819:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787841608.125461:0:5819:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787841608.125465:0:5819:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1787841608.125467:0:5819:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787841608.125468:0:5819:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787841608.125469:0:5819:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787841608.125470:0:5819:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787841608.125471:0:5819:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787841608.125472:0:5819:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787841608.125472:0:5819:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787841608.125473:0:5819:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787841608.125474:0:5819:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787841608.125475:0:5819:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787841608.125475:0:5819:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787841608.125476:0:5819:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787841608.125504:0:5819:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787841608.125521:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b30f657c pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5819:1874687714921216:0@lo:253: 00000100:00100000:1.0:1787841608.125593:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841608.125644:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set 000000002b4a4cea going to sleep for 11 seconds 00000100:00100000:0.0:1787841608.125809:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714921216 00000100:00100000:0.0:1787841608.125817:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714921216 00000100:00100000:0.0:1787841608.125869:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787841608.125885:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ddbb53bc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+12:5819:x1874687714921216:12345-0@lo:253: 20000000:01000000:0.0:1787841608.125910:0:5831:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787841608.125922:0:5831:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787841608.161263:0:5831:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787841608.161284:0:5831:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1787841608.161684:0:5853:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787841608.161689:0:5853:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787841608.161728:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000007929592b/0xe3dac0c99affe05a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841608.161750:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000006504d9f7/0xe3dac0c99affe029 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe3dac0c99affe022 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841608.161758:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000007929592b/0xe3dac0c99affe05a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841608.161798:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000006504d9f7/0xe3dac0c99affe029 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe3dac0c99affe022 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841608.161812:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000006504d9f7/0xe3dac0c99affe029 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe3dac0c99affe022 expref: 12 pid: 5832 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841608.161826:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fd0d10b0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5853:1874687714921344:0@lo:104: 00000100:00100000:2.0:1787841608.161981:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841608.162072:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set 000000008456c58f going to sleep for 11 seconds 00000100:00100000:1.0:1787841608.162230:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714921344 00000100:00100000:1.0:1787841608.162238:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714921344 00000100:00100000:1.0:1787841608.162582:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787841608.162591:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fd6258e8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+3:5853:x1874687714921344:12345-0@lo:104: 00010000:00010000:1.0:1787841608.162604:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.101@tcp lock: 000000008da2c841/0xe3dac0c99affe022 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe3dac0c99affe029 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841608.162675:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787841608.162680:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fd6258e8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+3:5853:x1874687714921344:12345-0@lo:104: Request processed in 92us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841608.162687:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787841608.162800:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fd0d10b0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5853:1874687714921344:0@lo:104: 00010000:00010000:2.0:1787841608.162825:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000007929592b/0xe3dac0c99affe05a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841608.162943:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787841608.162950:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.101@tcp lock: 000000008da2c841/0xe3dac0c99affe022 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe3dac0c99affe029 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841608.162959:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008da2c841 already unused, calling callback (00000000f1e38a88) 10000000:00010000:3.0:1787841608.162963:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.101@tcp lock: 000000008da2c841/0xe3dac0c99affe022 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe3dac0c99affe029 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841608.162985:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.101@tcp lock: 000000008da2c841/0xe3dac0c99affe022 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe3dac0c99affe029 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787841608.162993:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.101@tcp lock: 000000008da2c841/0xe3dac0c99affe022 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe3dac0c99affe029 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787841608.162999:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787841608.163034:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.101@tcp lock: 000000008da2c841/0xe3dac0c99affe022 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99affe029 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841608.163051:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787841608.163075:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.101@tcp lock: 000000008da2c841/0xe3dac0c99affe022 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99affe029 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841608.163082:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.101@tcp lock: 000000008da2c841/0xe3dac0c99affe022 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99affe029 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841608.163107:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841608.163109:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841608.163110:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787841608.163158:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b1fadf27 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3299:1874687714921472:0@lo:103: 00000100:00100000:0.0:1787841608.163192:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841608.164423:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714921472 00000100:00100000:3.0:1787841608.164437:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714921472 00010000:00010000:3.0:1787841608.164472:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000006504d9f7/0xe3dac0c99affe029 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe3dac0c99affe022 expref: 13 pid: 5832 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841608.164506:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787841608.164513:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a626a996 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+13:3299:x1874687714921472:12345-0@lo:103: 00010000:00010000:3.0:1787841608.164526:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787841608.164530:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000006504d9f7/0xe3dac0c99affe029 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe3dac0c99affe022 expref: 13 pid: 5832 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841608.164550:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000006504d9f7/0xe3dac0c99affe029 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe3dac0c99affe022 expref: 13 pid: 5832 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841608.164565:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006504d9f7/0xe3dac0c99affe029 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe3dac0c99affe022 expref: 13 pid: 5832 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841608.164577:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000007929592b/0xe3dac0c99affe05a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841608.164584:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007929592b/0xe3dac0c99affe05a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787841608.164597:0:5823:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002908681s 00010000:00010000:3.0:1787841608.164601:0:5823:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000007929592b/0xe3dac0c99affe05a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841608.164607:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000007929592b/0xe3dac0c99affe05a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841608.164611:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000007929592b/0xe3dac0c99affe05a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841608.164616:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000007929592b/0xe3dac0c99affe05a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841608.164621:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000007929592b already unused, calling callback (000000004b9b3d27) 00010000:00010000:3.0:1787841608.164624:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000007929592b/0xe3dac0c99affe05a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841608.164629:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000007929592b/0xe3dac0c99affe05a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841608.164656:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000007929592b/0xe3dac0c99affe05a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841608.164667:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787841608.164716:0:5853:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000007929592b/0xe3dac0c99affe05a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841608.164724:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000007929592b/0xe3dac0c99affe05a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841608.164730:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000007929592b/0xe3dac0c99affe05a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841608.164741:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a626a996 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+12:3299:x1874687714921472:12345-0@lo:103: Request processed in 228us (1549us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841608.164748:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787841608.164799:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b1fadf27 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3299:1874687714921472:0@lo:103: 00000100:00100000:2.0:1787841608.173636:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ddbb53bc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+11:5819:x1874687714921216:12345-0@lo:253: Request processed in 47752us (48035us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841608.173650:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787841608.173788:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b30f657c pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5819:1874687714921216:0@lo:253: 10000000:01000000:1.0:1787841608.173803:0:5819:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1787841608.173806:0:5819:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787841608.173808:0:5819:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787841608.173809:0:5819:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787841608.173810:0:5819:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787841608.173811:0:5819:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787841608.173812:0:5819:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787841608.173813:0:5819:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787841608.173815:0:5819:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787841608.173816:0:5819:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787841608.173817:0:5819:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787841608.173818:0:5819:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787841608.173819:0:5819:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787841608.173836:0:5819:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787841608.182411:0:5819:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1787841608.182847:0:5819:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787841608.185481:0:5819:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1787841608.185651:0:5819:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787841608.185871:0:5819:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1787841608.188749:0:5819:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1787841608.189688:0:5819:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1787841608.189873:0:5819:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1787841608.190619:0:5819:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1787841608.190805:0:5819:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1787841608.192118:0:5819:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1787841608.192399:0:5819:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:2.0:1787841608.246197:0:5819:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00010000:00010000:3.0:1787841608.257621:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1787841608.311256:0:5819:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1787841608.316544:0:5871:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1787841608.316558:0:5871:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:2.0:1787841608.317540:0:5872:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1787841608.321138:0:5819:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1787841608.321322:0:5819:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1787841608.321776:0:5819:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1787841608.321785:0:5819:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1787841608.321905:0:5819:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787841608.328647:0:5819:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1787841608.330150:0:5819:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1787841608.330212:0:5819:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1787841608.332620:0:5819:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1787841608.332886:0:5819:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:0.0:1787841608.336187:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1787841608.336339:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1787841608.336516:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1787841608.336659:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1787841608.336858:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1787841608.337018:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1787841608.337189:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1787841608.337325:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1787841608.337498:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1787841608.337653:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1787841608.337902:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1787841608.338040:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1787841608.344562:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1787841608.344800:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1787841608.344968:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1787841608.345219:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1787841608.345551:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1787841608.347287:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1787841608.347603:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1787841608.347777:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1787841608.347929:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1787841608.348065:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1787841608.349294:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1787841608.349442:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1787841608.349619:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1787841608.349814:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1787841608.349979:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1787841608.350352:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1787841608.350504:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1787841608.350628:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1787841608.350849:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1787841608.351011:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1787841608.352545:0:5819:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:2.0:1787841608.399312:0:5872:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:2.0:1787841608.463639:0:5819:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1787841608.463681:0:5819:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa5d881c57988 00100000:10000000:2.0:1787841608.463689:0:5819:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1787841608.465914:0:5819:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787841608.465933:0:5819:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.101@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787841608.465961:0:5819:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1787841608.465991:0:5819:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:3.0:1787841608.519136:0:5872:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1787841608.519222:0:5872:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1787841608.519228:0:5872:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:3.0:1787841609.284808:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841610.310391:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841611.332135:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841612.352927:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841613.380402:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787841613.568950:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787841613.568961:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787841613.568964:0:8:0:(import.c:65:import_set_state_nolock()) 0000000041b14861 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787841613.568979:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000041b14861 using connection 192.168.201.101@tcp/0@lo 00000100:00100000:1.0:1787841613.569063:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000033afa142 x1874687714921728/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787841613.569419:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000097b4a29c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3300:1874687714921600:0@lo:400: 00000100:00100000:2.0:1787841613.569501:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841613.569595:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000033afa142 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3297:1874687714921728:0@lo:38: 00000100:00100000:2.0:1787841613.569657:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841613.569751:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714921600 00000100:00100000:0.0:1787841613.569759:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714921600 00000100:00100000:1.0:1787841613.569838:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714921728 00000100:00100000:1.0:1787841613.569842:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714921728 00000100:00100000:1.0:1787841613.569875:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787841613.569881:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000062583540 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3297:x1874687714921728:12345-0@lo:38: 00010000:00080000:1.0:1787841613.569907:0:5839:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 153 last 0 00000020:00000080:1.0:1787841613.569943:0:5839:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xe3dac0c99affe061 00000004:00100000:1.0:1787841613.570021:0:5839:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787841613.570175:0:5839:0:(import.c:65:import_set_state_nolock()) 00000000ce7b0a91 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787841613.570227:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000062583540 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1874687714921728:12345-0@lo:38: Request processed in 346us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841613.570235:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787841613.570366:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787841613.570373:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a56ac943 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+11:3300:x1874687714921600:12345-0@lo:400: 00000100:00100000:0.0:1787841613.570414:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a56ac943 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+11:3300:x1874687714921600:12345-0@lo:400: Request processed in 43us (915us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841613.570420:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787841613.570463:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000097b4a29c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3300:1874687714921600:0@lo:400: 00010000:00080000:2.0:1787841613.576577:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000033afa142 x1874687714921728/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787841623 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787841613.576603:0:3297:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1787841613.576611:0:3297:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1787841613.576617:0:3297:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787841613.576620:0:3297:0:(import.c:65:import_set_state_nolock()) 0000000041b14861 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787841613.576626:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000033afa142 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3297:1874687714921728:0@lo:38: 00000001:02000400:0.0:1787841613.622092:0:6115:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg101-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787841614.404606:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841615.425200:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841616.449455:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787841617.156447:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787841617.156458:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff92cbc3ed8000 from 3 10000000:01000000:3.0:1787841617.156464:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787841617.156518:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: 000000000024c0ed/0xe3dac0c99affe068 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841617.156532:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: 000000000024c0ed/0xe3dac0c99affe068 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841617.156543:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: 000000000024c0ed/0xe3dac0c99affe068 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841617.156570:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000972eae66 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714921856:0@lo:101: 00000100:00100000:3.0:1787841617.156660:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841617.156776:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set 000000003f672307 going to sleep for 11 seconds 00000100:00100000:0.0:1787841617.156843:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714921856 00000100:00100000:0.0:1787841617.156859:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714921856 00000100:00100000:0.0:1787841617.156937:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787841617.156948:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007c6c75c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+11:5836:x1874687714921856:12345-0@lo:101: 00010000:00010000:0.0:1787841617.156980:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841617.157003:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000543b088/0xe3dac0c99affe06f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe3dac0c99affe068 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841617.157038:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000543b088/0xe3dac0c99affe06f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe3dac0c99affe068 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841617.157078:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000543b088/0xe3dac0c99affe06f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe3dac0c99affe068 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841617.157092:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000543b088, rc 0) 00000100:00100000:0.0:1787841617.157184:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007c6c75c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+12:5836:x1874687714921856:12345-0@lo:101: Request processed in 238us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841617.157196:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787841617.157314:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000972eae66 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714921856:0@lo:101: 00010000:00010000:3.0:1787841617.157336:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: 000000000024c0ed/0xe3dac0c99affe068 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe06f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841617.157346:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: 000000000024c0ed/0xe3dac0c99affe068 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe3dac0c99affe06f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841617.157402:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000972eae66 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714921984:0@lo:256: 00000100:00100000:3.0:1787841617.157438:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841617.157467:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set 000000003f672307 going to sleep for 11 seconds 00000100:00100000:1.0:1787841617.157527:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714921984 00000100:00100000:1.0:1787841617.157533:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714921984 00000100:00100000:1.0:1787841617.157583:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787841617.157590:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000005f6060f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+12:5836:x1874687714921984:12345-0@lo:256: 20000000:01000000:1.0:1787841617.157619:0:5833:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787841617.157637:0:5833:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787841617.157640:0:5833:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1787841617.158348:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000005f6060f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+12:5836:x1874687714921984:12345-0@lo:256: Request processed in 753us (905us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841617.158360:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787841617.158387:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000972eae66 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714921984:0@lo:256: 10000000:01000000:0.0:1787841617.158480:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787841617.158492:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: 000000000024c0ed/0xe3dac0c99affe068 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe06f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841617.158503:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: 000000000024c0ed/0xe3dac0c99affe068 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe06f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841617.479075:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841618.496978:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787841618.689191:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008345b5f8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874687714922240:0@lo:400: 00000100:00100000:1.0:1787841618.689199:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787841618.689219:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b9dde5b4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3300:1874687714922112:0@lo:400: 00000100:00100000:1.0:1787841618.698276:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841618.698277:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841618.698352:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714922112 00000100:00100000:1.0:1787841618.698361:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714922112 00000100:00100000:3.0:1787841618.698494:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714922240 00000100:00100000:3.0:1787841618.698499:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714922240 00000100:00100000:3.0:1787841618.698552:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787841618.698561:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000496391e0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874687714922240:12345-0@lo:400: 00000100:00100000:3.0:1787841618.698633:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000496391e0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874687714922240:12345-0@lo:400: Request processed in 74us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841618.698647:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787841618.698772:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787841618.698779:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b792bdcc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+12:3300:x1874687714922112:12345-0@lo:400: 00000100:00100000:1.0:1787841618.698813:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b792bdcc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+12:3300:x1874687714922112:12345-0@lo:400: Request processed in 35us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841618.698819:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:2.0:1787841618.699151:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000008345b5f8 x1874687714922240/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787841634 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787841618.699166:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008345b5f8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874687714922240:0@lo:400: 00000100:00100000:1.0:1787841618.699902:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b9dde5b4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3300:1874687714922112:0@lo:400: 00000020:00000080:1.0:1787841619.423305:0:6317:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdb1d41a80 20000000:00000080:1.0:1787841619.423326:0:6317:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff92cbf8ead000 uarg=0000000000000000 20000000:01000000:1.0:1787841619.423361:0:6317:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1787841619.423366:0:6317:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1787841619.423371:0:6317:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1787841619.423559:0:6317:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1787841619.423569:0:6317:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:1.0:1787841619.437612:0:6317:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787841619.438389:0:6317:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1787841619.438452:0:6317:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:1.0:1787841619.438503:0:6317:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:1.0:1787841619.438521:0:6317:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787841619.438540:0:6317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000829884c7/0xe3dac0c99affe076 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841619.438559:0:6317:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000007c984001/0xe3dac0c99affe037 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe3dac0c99affe030 expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841619.438566:0:6317:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000829884c7/0xe3dac0c99affe076 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841619.438608:0:6317:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000007c984001/0xe3dac0c99affe037 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe3dac0c99affe030 expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841619.438635:0:6317:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000007c984001/0xe3dac0c99affe037 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe3dac0c99affe030 expref: 11 pid: 5833 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841619.438651:0:6317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000b8b5d6c pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6317:1874687714922368:0@lo:104: 00000100:00100000:1.0:1787841619.441967:0:6317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841619.442040:0:6317:0:(client.c:2715:ptlrpc_set_wait()) set 00000000be24ef53 going to sleep for 11 seconds 00000100:00100000:0.0:1787841619.442151:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714922368 00000100:00100000:0.0:1787841619.442161:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714922368 00000100:00100000:0.0:1787841619.442223:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787841619.442231:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002fe7d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+3:6317:x1874687714922368:12345-0@lo:104: 00010000:00010000:0.0:1787841619.442249:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.101@tcp lock: 00000000f3bff496/0xe3dac0c99affe030 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe3dac0c99affe037 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841619.442319:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787841619.442324:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002fe7d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+3:6317:x1874687714922368:12345-0@lo:104: Request processed in 95us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841619.442332:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1787841619.442356:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787841619.442375:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.101@tcp lock: 00000000f3bff496/0xe3dac0c99affe030 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe3dac0c99affe037 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841619.442383:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f3bff496 already unused, calling callback (00000000f1e38a88) 10000000:00010000:0.0:1787841619.442386:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.101@tcp lock: 00000000f3bff496/0xe3dac0c99affe030 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe3dac0c99affe037 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841619.442394:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.101@tcp lock: 00000000f3bff496/0xe3dac0c99affe030 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe3dac0c99affe037 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787841619.442400:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.101@tcp lock: 00000000f3bff496/0xe3dac0c99affe030 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe3dac0c99affe037 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787841619.442406:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787841619.442439:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.101@tcp lock: 00000000f3bff496/0xe3dac0c99affe030 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99affe037 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841619.442446:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787841619.442464:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.101@tcp lock: 00000000f3bff496/0xe3dac0c99affe030 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99affe037 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841619.442470:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.101@tcp lock: 00000000f3bff496/0xe3dac0c99affe030 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99affe037 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841619.442485:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841619.442487:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841619.442488:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787841619.442507:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006994a8e4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3299:1874687714922496:0@lo:103: 00000100:00100000:0.0:1787841619.442543:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841619.442809:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714922496 00000100:00100000:0.0:1787841619.442823:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714922496 00010000:00010000:0.0:1787841619.442879:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000007c984001/0xe3dac0c99affe037 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe3dac0c99affe030 expref: 12 pid: 5833 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841619.442938:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787841619.442948:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007a888fee pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+12:3299:x1874687714922496:12345-0@lo:103: 00010000:00010000:0.0:1787841619.442967:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787841619.442973:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000007c984001/0xe3dac0c99affe037 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe3dac0c99affe030 expref: 12 pid: 5833 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841619.442986:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000007c984001/0xe3dac0c99affe037 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe3dac0c99affe030 expref: 12 pid: 5833 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841619.443014:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000829884c7/0xe3dac0c99affe076 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841619.443024:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000829884c7/0xe3dac0c99affe076 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841619.443046:0:5823:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000829884c7/0xe3dac0c99affe076 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841619.443054:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000829884c7/0xe3dac0c99affe076 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841619.443060:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000829884c7/0xe3dac0c99affe076 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841619.443066:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000829884c7/0xe3dac0c99affe076 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841619.443073:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000829884c7 already unused, calling callback (000000004b9b3d27) 00010000:00010000:0.0:1787841619.443077:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000829884c7/0xe3dac0c99affe076 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841619.443094:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000829884c7/0xe3dac0c99affe076 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841619.443107:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000829884c7/0xe3dac0c99affe076 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841619.443120:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787841619.443158:0:6317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000007c984001/0xe3dac0c99affe037 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe3dac0c99affe030 expref: 12 pid: 5833 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841619.443172:0:6317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000b8b5d6c pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6317:1874687714922368:0@lo:104: 00010000:00010000:1.0:1787841619.443191:0:6317:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000829884c7/0xe3dac0c99affe076 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841619.443198:0:6317:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000829884c7/0xe3dac0c99affe076 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841619.443203:0:6317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000829884c7/0xe3dac0c99affe076 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841619.443207:0:6317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000829884c7/0xe3dac0c99affe076 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841619.443280:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007a888fee pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+11:3299:x1874687714922496:12345-0@lo:103: Request processed in 333us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841619.443291:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787841619.443398:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006994a8e4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3299:1874687714922496:0@lo:103: 00010000:00010000:1.0:1787841619.520862:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841620.554263:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841621.569193:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841622.593182:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841623.621322:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787841623.826688:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e3e9266b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874687714922752:0@lo:400: 00000100:00100000:1.0:1787841623.826831:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841623.826926:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787841623.826934:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000481104c9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3301:1874687714922624:0@lo:400: 00000100:00100000:1.0:1787841623.826985:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841623.827025:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714922752 00000100:00100000:1.0:1787841623.827035:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714922752 00000100:00100000:1.0:1787841623.827093:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787841623.827103:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000da610cc9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874687714922752:12345-0@lo:400: 00000100:00100000:1.0:1787841623.827237:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000da610cc9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874687714922752:12345-0@lo:400: Request processed in 134us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841623.827245:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787841623.827347:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714922624 00000100:00100000:1.0:1787841623.827351:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714922624 00000100:00100000:1.0:1787841623.827381:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787841623.827388:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000046e76532 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+11:3301:x1874687714922624:12345-0@lo:400: 00000100:00100000:1.0:1787841623.827422:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000046e76532 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+11:3301:x1874687714922624:12345-0@lo:400: Request processed in 35us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841623.827429:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787841623.828099:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000481104c9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3301:1874687714922624:0@lo:400: 00010000:00080000:1.0:1787841623.828120:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000e3e9266b x1874687714922752/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787841639 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787841623.828135:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e3e9266b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874687714922752:0@lo:400: 00010000:00010000:2.0:1787841624.641492:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841625.664915:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787841626.211910:0:6684:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787841626.211915:0:6684:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1787841626.212061:0:6684:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 0000000090912882 00000020:01000004:2.0:1787841626.212081:0:6684:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1787841626.212093:0:6684:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1787841626.212108:0:6684:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (000000004884d6c8) 00000020:00000080:2.0:1787841626.212125:0:6684:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787841626.235940:0:6684:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1787841626.236312:0:6684:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1787841626.259244:0:6684:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1787841626.265108:0:6684:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787841626.265139:0:6684:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1787841626.265201:0:6684:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787841626.265220:0:6684:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1787841626.266945:0:6684:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1787841626.266973:0:6684:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787841626.267000:0:6684:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xe3dac0c99affe084 00000020:01000004:2.0:1787841626.267010:0:6684:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1787841626.267047:0:6684:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.101@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787841626.267051:0:6684:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.101@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787841626.267057:0:6684:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1787841626.267063:0:6684:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1787841626.267080:0:6684:0:(genops.c:413:class_newdev()) Allocate new device OSS (00000000dcb20b15) 00000020:00000080:2.0:1787841626.267093:0:6684:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1787841626.269137:0:6684:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787841626.269333:0:6684:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1787841626.269339:0:6684:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1787841626.270163:0:6684:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1787841626.270173:0:6684:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1787841626.272088:0:6684:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1787841626.272104:0:6684:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1787841626.283496:0:6684:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787841626.284074:0:6684:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1787841626.284083:0:6684:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1787841626.285044:0:6684:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1787841626.285054:0:6684:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1787841626.316245:0:6684:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787841626.316552:0:6684:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787841626.316559:0:6684:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1787841626.319859:0:6684:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787841626.319885:0:6684:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1787841626.321926:0:6684:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787841626.321947:0:6684:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1787841626.325648:0:6684:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787841626.326202:0:6684:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1787841626.326209:0:6684:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1787841626.327657:0:6684:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1787841626.327669:0:6684:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1787841626.407840:0:6684:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787841626.408175:0:6684:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1787841626.408183:0:6684:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1787841626.413317:0:6684:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1787841626.413340:0:6684:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1787841626.414134:0:6684:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1787841626.414169:0:6684:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1787841626.414178:0:6684:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.101@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1787841626.437643:0:6684:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.101@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787841626.437892:0:6684:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.101@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1787841626.437898:0:6684:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787841626.437906:0:6684:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787841626.437907:0:6684:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787841626.437908:0:6684:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787841626.437909:0:6684:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787841626.437910:0:6684:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787841626.437911:0:6684:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787841626.437913:0:6684:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787841626.437914:0:6684:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787841626.437916:0:6684:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787841626.437917:0:6684:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787841626.437922:0:6684:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1787841626.437924:0:6684:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787841626.437925:0:6684:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787841626.437926:0:6684:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787841626.437927:0:6684:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787841626.437928:0:6684:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787841626.437929:0:6684:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787841626.437930:0:6684:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787841626.437930:0:6684:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787841626.437931:0:6684:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787841626.437932:0:6684:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787841626.437933:0:6684:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787841626.438054:0:6684:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787841626.438080:0:6684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009de009c3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:6684:1874687714922880:0@lo:253: 00000100:00100000:2.0:1787841626.438202:0:6684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841626.438351:0:6684:0:(client.c:2715:ptlrpc_set_wait()) set 00000000239a52fa going to sleep for 11 seconds 00000100:00100000:1.0:1787841626.438485:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714922880 00000100:00100000:1.0:1787841626.438496:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714922880 00000100:00100000:1.0:1787841626.438615:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787841626.438626:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002826c74e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+11:6684:x1874687714922880:12345-0@lo:253: 20000000:01000000:1.0:1787841626.438673:0:5831:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1787841626.438678:0:5831:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1787841626.438692:0:5831:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1787841626.438715:0:5831:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1787841626.439855:0:5831:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787841626.440090:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1787841626.440106:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1787841626.440148:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:1.0:1787841626.440157:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1787841626.440188:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:1.0:1787841626.440254:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:1.0:1787841626.440643:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:1.0:1787841626.440666:0:5831:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.101@tcp 20000000:01000000:1.0:1787841626.440669:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.101@tcp (null) (null) (null) 00000040:00080000:1.0:1787841626.440736:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:1.0:1787841626.440745:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787841626.440795:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:1.0:1787841626.440817:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.201.101@tcp (null) (null) 00000040:00080000:1.0:1787841626.440852:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:1.0:1787841626.440862:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1787841626.440890:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:1.0:1787841626.440938:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:1.0:1787841626.441675:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:1.0:1787841626.441695:0:5831:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.101@tcp 20000000:01000000:1.0:1787841626.441728:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.101@tcp (null) (null) (null) 00000040:00080000:1.0:1787841626.441767:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:1.0:1787841626.441775:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1787841626.443457:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:1.0:1787841626.443488:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.201.101@tcp (null) (null) 00000040:00080000:1.0:1787841626.443609:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:1.0:1787841626.443621:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1787841626.443655:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:1.0:1787841626.443694:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:1.0:1787841626.443761:0:5831:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:1.0:1787841626.443778:0:5831:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1787841626.443783:0:5831:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1787841626.443799:0:5831:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787841626.443810:0:5831:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1787841626.443867:0:5831:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787841626.443869:0:5831:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787841626.445323:0:6699:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:3.0:1787841626.445411:0:6699:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:3.0:1787841626.445468:0:6699:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:1.0:1787841626.446524:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:1.0:1787841626.446575:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:1.0:1787841626.446649:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:1.0:1787841626.446664:0:5831:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787841626.446667:0:5831:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787841626.449573:0:6700:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:2.0:1787841626.449694:0:6700:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:2.0:1787841626.449819:0:6700:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1787841626.450650:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:1.0:1787841626.450737:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:1.0:1787841626.450779:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:1.0:1787841626.450794:0:5831:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1787841626.450798:0:5831:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787841626.451514:0:6701:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:1.0:1787841626.451985:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:1.0:1787841626.452034:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:1.0:1787841626.452114:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:1.0:1787841626.452131:0:5831:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:1.0:1787841626.452133:0:5831:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:1.0:1787841626.452146:0:5831:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1787841626.452171:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000074a1c9bc/0xe3dac0c99affe092 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841626.452199:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000007fff31c5/0xe3dac0c99affdfb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe3dac0c99affdfb2 expref: 11 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841626.452207:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000c95fddcb/0xe3dac0c99affdfd5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe3dac0c99affdfce expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841626.452213:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000eb49020f/0xe3dac0c99affe045 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe3dac0c99affe03e expref: 11 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841626.452236:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000074a1c9bc/0xe3dac0c99affe092 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841626.452288:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000eb49020f/0xe3dac0c99affe045 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe3dac0c99affe03e expref: 11 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841626.452317:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000eb49020f/0xe3dac0c99affe045 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe3dac0c99affe03e expref: 11 pid: 5831 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841626.452336:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000092a744f2 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5831:1874687714923008:0@lo:104: 00000100:00100000:1.0:1787841626.452429:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841626.452501:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714923008 00010000:00010000:1.0:1787841626.452505:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000c95fddcb/0xe3dac0c99affdfd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe3dac0c99affdfce expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841626.452512:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714923008 00010000:00010000:1.0:1787841626.452516:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000c95fddcb/0xe3dac0c99affdfd5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe3dac0c99affdfce expref: 11 pid: 5833 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841626.452526:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e3e9266b pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5831:1874687714923136:0@lo:104: 00000100:00100000:1.0:1787841626.452552:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841626.452685:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714923136 00000100:00100000:0.0:1787841626.452690:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714923136 00010000:00010000:1.0:1787841626.452731:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000007fff31c5/0xe3dac0c99affdfb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe3dac0c99affdfb2 expref: 11 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841626.452741:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000007fff31c5/0xe3dac0c99affdfb9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe3dac0c99affdfb2 expref: 11 pid: 5832 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841626.452751:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009eac637b pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5831:1874687714923264:0@lo:104: 00000100:00100000:0.0:1787841626.452754:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787841626.452765:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c78f22a1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+4:5831:x1874687714923008:12345-0@lo:104: 00000100:00100000:1.0:1787841626.452782:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787841626.452782:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.101@tcp lock: 00000000c859b377/0xe3dac0c99affe03e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe3dac0c99affe045 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841626.452797:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set 000000002f804efc going to sleep for 11 seconds 00010000:00010000:0.0:1787841626.452869:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787841626.452875:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c78f22a1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+4:5831:x1874687714923008:12345-0@lo:104: Request processed in 112us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841626.452883:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787841626.452888:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000092a744f2 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5831:1874687714923008:0@lo:104: 00000100:00100000:0.0:1787841626.452903:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714923264 00000100:00100000:0.0:1787841626.452907:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714923264 00000100:00100000:0.0:1787841626.452934:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787841626.452939:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000481104c9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+4:5831:x1874687714923136:12345-0@lo:104: 00010000:00010000:3.0:1787841626.453048:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787841626.453054:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.101@tcp lock: 00000000c859b377/0xe3dac0c99affe03e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe3dac0c99affe045 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841626.453064:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c859b377 already unused, calling callback (00000000f1e38a88) 10000000:00010000:3.0:1787841626.453067:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.101@tcp lock: 00000000c859b377/0xe3dac0c99affe03e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xe3dac0c99affe045 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841626.453076:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.101@tcp lock: 00000000c859b377/0xe3dac0c99affe03e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xe3dac0c99affe045 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787841626.453083:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.101@tcp lock: 00000000c859b377/0xe3dac0c99affe03e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xe3dac0c99affe045 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787841626.453089:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787841626.453136:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.101@tcp lock: 00000000c859b377/0xe3dac0c99affe03e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99affe045 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841626.453143:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787841626.453166:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.101@tcp lock: 00000000c859b377/0xe3dac0c99affe03e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99affe045 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841626.453179:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.101@tcp lock: 00000000c859b377/0xe3dac0c99affe03e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99affe045 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841626.453193:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841626.453195:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841626.453196:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787841626.453211:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f69fb54d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3298:1874687714923392:0@lo:103: 00000100:00100000:3.0:1787841626.453246:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841626.453297:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714923392 00000100:00100000:3.0:1787841626.453300:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714923392 00010000:00010000:3.0:1787841626.453320:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000eb49020f/0xe3dac0c99affe045 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe3dac0c99affe03e expref: 12 pid: 5831 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841626.453342:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787841626.453348:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000035588722 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+12:3298:x1874687714923392:12345-0@lo:103: 00010000:00010000:3.0:1787841626.453359:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787841626.453363:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000eb49020f/0xe3dac0c99affe045 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe3dac0c99affe03e expref: 12 pid: 5831 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841626.453373:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000eb49020f/0xe3dac0c99affe045 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe3dac0c99affe03e expref: 12 pid: 5831 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841626.453388:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000eb49020f/0xe3dac0c99affe045 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe3dac0c99affe03e expref: 12 pid: 5831 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841626.453403:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787841626.453430:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000035588722 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+11:3298:x1874687714923392:12345-0@lo:103: Request processed in 83us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841626.453445:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787841626.453476:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f69fb54d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3298:1874687714923392:0@lo:103: 00010000:00010000:0.0:1787841626.453524:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.101@tcp lock: 00000000df6d90df/0xe3dac0c99affdfce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe3dac0c99affdfd5 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841626.453580:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787841626.453585:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000481104c9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+4:5831:x1874687714923136:12345-0@lo:104: Request processed in 647us (1034us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841626.453593:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787841626.453611:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787841626.453619:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000b8b5d6c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+3:5831:x1874687714923264:12345-0@lo:104: 00000100:00100000:1.0:1787841626.453626:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e3e9266b pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5831:1874687714923136:0@lo:104: 00010000:00010000:0.0:1787841626.453626:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.101@tcp lock: 0000000015e2fd2d/0xe3dac0c99affdfb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe3dac0c99affdfb9 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841626.453675:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787841626.453680:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000b8b5d6c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+3:5831:x1874687714923264:12345-0@lo:104: Request processed in 64us (901us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841626.453687:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787841626.453906:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009eac637b pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5831:1874687714923264:0@lo:104: 00010000:00010000:1.0:1787841626.453930:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000074a1c9bc/0xe3dac0c99affe092 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841626.455049:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787841626.455059:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.101@tcp lock: 00000000df6d90df/0xe3dac0c99affdfce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe3dac0c99affdfd5 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841626.455071:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000df6d90df already unused, calling callback (00000000f1e38a88) 10000000:00010000:3.0:1787841626.455075:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.101@tcp lock: 00000000df6d90df/0xe3dac0c99affdfce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe3dac0c99affdfd5 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841626.455083:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.101@tcp lock: 00000000df6d90df/0xe3dac0c99affdfce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe3dac0c99affdfd5 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787841626.455089:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.101@tcp lock: 00000000df6d90df/0xe3dac0c99affdfce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe3dac0c99affdfd5 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787841626.455094:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787841626.455341:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.101@tcp lock: 00000000df6d90df/0xe3dac0c99affdfce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99affdfd5 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841626.455348:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787841626.455377:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.101@tcp lock: 00000000df6d90df/0xe3dac0c99affdfce lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99affdfd5 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841626.455384:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.101@tcp lock: 00000000df6d90df/0xe3dac0c99affdfce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99affdfd5 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841626.455403:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787841626.455405:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.101@tcp lock: 0000000015e2fd2d/0xe3dac0c99affdfb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe3dac0c99affdfb9 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841626.455428:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000015e2fd2d already unused, calling callback (00000000f1e38a88) 10000000:00010000:3.0:1787841626.455430:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.101@tcp lock: 0000000015e2fd2d/0xe3dac0c99affdfb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe3dac0c99affdfb9 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841626.455435:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.101@tcp lock: 0000000015e2fd2d/0xe3dac0c99affdfb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe3dac0c99affdfb9 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787841626.455439:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.101@tcp lock: 0000000015e2fd2d/0xe3dac0c99affdfb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe3dac0c99affdfb9 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787841626.455443:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1787841626.455475:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787841626.455501:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f69fb54d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3298:1874687714923520:0@lo:103: 00000100:00100000:2.0:1787841626.455582:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841626.455743:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714923520 00000100:00100000:0.0:1787841626.455753:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714923520 00010000:00010000:0.0:1787841626.455789:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000c95fddcb/0xe3dac0c99affdfd5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe3dac0c99affdfce expref: 11 pid: 5833 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841626.455835:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787841626.455844:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008345b5f8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+11:3298:x1874687714923520:12345-0@lo:103: 00010000:00010000:0.0:1787841626.455859:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787841626.455864:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000c95fddcb/0xe3dac0c99affdfd5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe3dac0c99affdfce expref: 11 pid: 5833 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841626.455888:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000c95fddcb/0xe3dac0c99affdfd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe3dac0c99affdfce expref: 11 pid: 5833 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841626.455905:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c95fddcb/0xe3dac0c99affdfd5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe3dac0c99affdfce expref: 11 pid: 5833 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841626.455921:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787841626.455964:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008345b5f8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+10:3298:x1874687714923520:12345-0@lo:103: Request processed in 122us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841626.455973:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787841626.456016:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f69fb54d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3298:1874687714923520:0@lo:103: 00010000:00010000:3.0:1787841626.456351:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.101@tcp lock: 0000000015e2fd2d/0xe3dac0c99affdfb2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99affdfb9 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841626.456359:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787841626.456400:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000bd9f501 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3300:1874687714923648:0@lo:103: 00000100:00100000:0.0:1787841626.456433:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841626.456504:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714923648 00000100:00100000:2.0:1787841626.456509:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714923648 00010000:00010000:2.0:1787841626.456528:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000007fff31c5/0xe3dac0c99affdfb9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe3dac0c99affdfb2 expref: 10 pid: 5832 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841626.456564:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787841626.456570:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000063fd09bf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+10:3300:x1874687714923648:12345-0@lo:103: 00010000:00010000:2.0:1787841626.456578:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787841626.456581:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000007fff31c5/0xe3dac0c99affdfb9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe3dac0c99affdfb2 expref: 10 pid: 5832 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841626.456589:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000007fff31c5/0xe3dac0c99affdfb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe3dac0c99affdfb2 expref: 10 pid: 5832 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841626.456599:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000007fff31c5/0xe3dac0c99affdfb9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe3dac0c99affdfb2 expref: 10 pid: 5832 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841626.456613:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000074a1c9bc/0xe3dac0c99affe092 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841626.456621:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000074a1c9bc/0xe3dac0c99affe092 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841626.456639:0:5824:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000074a1c9bc/0xe3dac0c99affe092 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841626.456645:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000074a1c9bc/0xe3dac0c99affe092 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841626.456650:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000074a1c9bc/0xe3dac0c99affe092 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841626.456655:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000074a1c9bc/0xe3dac0c99affe092 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841626.456668:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000074a1c9bc already unused, calling callback (000000004b9b3d27) 00010000:00010000:2.0:1787841626.456671:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000074a1c9bc/0xe3dac0c99affe092 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841626.456678:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000074a1c9bc/0xe3dac0c99affe092 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841626.456689:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000074a1c9bc/0xe3dac0c99affe092 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841626.456729:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787841626.456787:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.101@tcp lock: 0000000015e2fd2d/0xe3dac0c99affdfb2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99affdfb9 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841626.456793:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.101@tcp lock: 0000000015e2fd2d/0xe3dac0c99affdfb2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99affdfb9 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841626.456819:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841626.456821:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841626.456823:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841626.456838:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841626.456957:0:5831:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000074a1c9bc/0xe3dac0c99affe092 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841626.456966:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000074a1c9bc/0xe3dac0c99affe092 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841626.456972:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000074a1c9bc/0xe3dac0c99affe092 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787841626.456985:0:5831:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1787841626.461258:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000063fd09bf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+9:3300:x1874687714923648:12345-0@lo:103: Request processed in 4669us (4804us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841626.461283:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787841626.462089:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000bd9f501 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3300:1874687714923648:0@lo:103: 00000100:00100000:1.0:1787841626.493002:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002826c74e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+8:6684:x1874687714922880:12345-0@lo:253: Request processed in 54365us (54788us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841626.493022:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787841626.493159:0:6684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009de009c3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:6684:1874687714922880:0@lo:253: 10000000:01000000:2.0:1787841626.493184:0:6684:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787841626.493189:0:6684:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787841626.493191:0:6684:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787841626.493193:0:6684:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787841626.493194:0:6684:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1787841626.493195:0:6684:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787841626.493196:0:6684:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787841626.493198:0:6684:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787841626.493200:0:6684:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1787841626.493202:0:6684:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787841626.493204:0:6684:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787841626.493239:0:6684:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000090912882 from lustre-OST0000 10000000:01000000:2.0:1787841626.493280:0:6684:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1787841626.493283:0:6684:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787841626.493295:0:6684:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff92cbe9a69a48 local copy 10000000:01000000:2.0:1787841626.493301:0:6684:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787841626.493388:0:6684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: 0000000048403d16/0xe3dac0c99affe099 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841626.493403:0:6684:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.101@tcp lock: 0000000048403d16/0xe3dac0c99affe099 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841626.493414:0:6684:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: 0000000048403d16/0xe3dac0c99affe099 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841626.493439:0:6684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009de009c3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:6684:1874687714923776:0@lo:101: 00000100:00100000:2.0:1787841626.493497:0:6684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841626.493576:0:6684:0:(client.c:2715:ptlrpc_set_wait()) set 000000006c1a072f going to sleep for 11 seconds 00000100:00100000:1.0:1787841626.493666:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714923776 00000100:00100000:1.0:1787841626.493674:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714923776 00000100:00100000:1.0:1787841626.493741:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787841626.493751:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c3a64f95 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+8:6684:x1874687714923776:12345-0@lo:101: 00010000:00010000:1.0:1787841626.493766:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841626.493783:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000074a1c9bc/0xe3dac0c99affe0a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe3dac0c99affe099 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841626.493821:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000074a1c9bc/0xe3dac0c99affe0a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe3dac0c99affe099 expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841626.493832:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000074a1c9bc/0xe3dac0c99affe0a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe3dac0c99affe099 expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841626.493849:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000074a1c9bc, rc 0) 00000100:00100000:1.0:1787841626.493890:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c3a64f95 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+9:6684:x1874687714923776:12345-0@lo:101: Request processed in 142us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841626.493896:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787841626.494099:0:6684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009de009c3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:6684:1874687714923776:0@lo:101: 00010000:00010000:3.0:1787841626.494117:0:6684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: 0000000048403d16/0xe3dac0c99affe099 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xe3dac0c99affe0a0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841626.494138:0:6684:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: 0000000048403d16/0xe3dac0c99affe099 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xe3dac0c99affe0a0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841626.494271:0:6684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000bd9f501 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:6684:1874687714923904:0@lo:501: 00000100:00100000:3.0:1787841626.494302:0:6684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841626.494333:0:6684:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e4b3f525 going to sleep for 11 seconds 00000100:00100000:1.0:1787841626.494396:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714923904 00000100:00100000:1.0:1787841626.494401:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714923904 00000100:00100000:1.0:1787841626.494434:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787841626.494439:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009a62a286 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+9:6684:x1874687714923904:12345-0@lo:501: 00000100:00100000:1.0:1787841626.494772:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009a62a286 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+9:6684:x1874687714923904:12345-0@lo:501: Request processed in 331us (469us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787841626.494780:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787841626.494924:0:6684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000bd9f501 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:6684:1874687714923904:0@lo:501: 10000000:01000000:2.0:1787841626.494941:0:6684:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.101@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787841626.494971:0:6684:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.101@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787841626.494978:0:6684:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: 0000000048403d16/0xe3dac0c99affe099 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xe3dac0c99affe0a0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841626.494985:0:6684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: 0000000048403d16/0xe3dac0c99affe099 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xe3dac0c99affe0a0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841626.494991:0:6684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.101@tcp lock: 0000000048403d16/0xe3dac0c99affe099 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xe3dac0c99affe0a0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841626.495016:0:6684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787841626.495039:0:6684:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff92cbf04e3800 10000000:01000000:2.0:1787841626.495045:0:6684:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787841626.495050:0:6684:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff92cbe9a69a48 10000000:01000000:2.0:1787841626.495052:0:6684:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1787841626.495056:0:6684:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff92cbe9a69a48 from 1 10000000:01000000:2.0:1787841626.495065:0:6684:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1787841626.495088:0:6684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: 000000007929592b/0xe3dac0c99affe0a7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841626.495094:0:6684:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: 000000007929592b/0xe3dac0c99affe0a7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841626.495100:0:6684:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: 000000007929592b/0xe3dac0c99affe0a7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841626.495111:0:6684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000036612f9f pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:6684:1874687714924032:0@lo:101: 00000100:00100000:2.0:1787841626.495140:0:6684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841626.495164:0:6684:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f6ba75a3 going to sleep for 11 seconds 00000100:00100000:2.0:1787841626.495181:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714924032 00000100:00100000:2.0:1787841626.495185:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714924032 00000100:00100000:2.0:1787841626.495216:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787841626.495222:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b3d00c58 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+9:6684:x1874687714924032:12345-0@lo:101: 00010000:00010000:2.0:1787841626.495232:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841626.495243:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ef5ffed9/0xe3dac0c99affe0ae lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe3dac0c99affe0a7 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841626.495259:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ef5ffed9/0xe3dac0c99affe0ae lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe3dac0c99affe0a7 expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841626.495268:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ef5ffed9/0xe3dac0c99affe0ae lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe3dac0c99affe0a7 expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841626.495276:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ef5ffed9, rc 0) 00000100:00100000:2.0:1787841626.495303:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b3d00c58 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+10:6684:x1874687714924032:12345-0@lo:101: Request processed in 82us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841626.495320:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787841626.495357:0:6684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000036612f9f pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:6684:1874687714924032:0@lo:101: 00010000:00010000:2.0:1787841626.495367:0:6684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: 000000007929592b/0xe3dac0c99affe0a7 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe0ae expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841626.495373:0:6684:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: 000000007929592b/0xe3dac0c99affe0a7 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe3dac0c99affe0ae expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787841626.495398:0:6684:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1787841626.495408:0:6684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: 000000007929592b/0xe3dac0c99affe0a7 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe0ae expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841626.495414:0:6684:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: 000000007929592b/0xe3dac0c99affe0a7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe0ae expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787841626.495420:0:6684:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787841626.495423:0:6684:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787841626.495427:0:6684:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1787841626.495428:0:6684:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787841626.495441:0:6684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: 0000000078c17dcc/0xe3dac0c99affe0b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841626.495446:0:6684:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: 0000000078c17dcc/0xe3dac0c99affe0b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841626.495451:0:6684:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: 0000000078c17dcc/0xe3dac0c99affe0b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841626.495460:0:6684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000036612f9f pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:6684:1874687714924160:0@lo:101: 00000100:00100000:2.0:1787841626.495488:0:6684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841626.495500:0:6684:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f6ba75a3 going to sleep for 11 seconds 00000100:00100000:2.0:1787841626.495519:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714924160 00000100:00100000:2.0:1787841626.495522:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714924160 00000100:00100000:2.0:1787841626.495543:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787841626.495547:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d50c5a83 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+10:6684:x1874687714924160:12345-0@lo:101: 00010000:00010000:2.0:1787841626.495553:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841626.495561:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000eb49020f/0xe3dac0c99affe0bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe3dac0c99affe0b5 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841626.495572:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000eb49020f/0xe3dac0c99affe0bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe3dac0c99affe0b5 expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841626.495590:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000eb49020f/0xe3dac0c99affe0bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe3dac0c99affe0b5 expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841626.495597:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000eb49020f, rc 0) 00000100:00100000:2.0:1787841626.495623:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d50c5a83 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+11:6684:x1874687714924160:12345-0@lo:101: Request processed in 75us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841626.495628:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787841626.495658:0:6684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000036612f9f pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:6684:1874687714924160:0@lo:101: 00010000:00010000:2.0:1787841626.495667:0:6684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: 0000000078c17dcc/0xe3dac0c99affe0b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe0bc expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841626.495673:0:6684:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: 0000000078c17dcc/0xe3dac0c99affe0b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe3dac0c99affe0bc expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841626.495776:0:6684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000036612f9f pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:6684:1874687714924288:0@lo:501: 00000100:00100000:2.0:1787841626.495819:0:6684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841626.495832:0:6684:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f6ba75a3 going to sleep for 11 seconds 00000100:00100000:2.0:1787841626.495845:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714924288 00000100:00100000:2.0:1787841626.495848:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714924288 00000100:00100000:2.0:1787841626.495868:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787841626.495873:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001f52dd08 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+11:6684:x1874687714924288:12345-0@lo:501: 00000100:00100000:2.0:1787841626.496092:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001f52dd08 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+11:6684:x1874687714924288:12345-0@lo:501: Request processed in 219us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841626.496099:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787841626.496129:0:6684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000036612f9f pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:6684:1874687714924288:0@lo:501: 00000100:00100000:2.0:1787841626.496154:0:6684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000036612f9f pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:6684:1874687714924416:0@lo:503: 00000100:00100000:2.0:1787841626.496192:0:6684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841626.496204:0:6684:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f6ba75a3 going to sleep for 11 seconds 00000100:00100000:2.0:1787841626.496216:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714924416 00000100:00100000:2.0:1787841626.496219:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714924416 00000100:00100000:2.0:1787841626.496238:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787841626.496243:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003fcd5b12 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+11:6684:x1874687714924416:12345-0@lo:503: 00000100:00100000:2.0:1787841626.496397:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003fcd5b12 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+11:6684:x1874687714924416:12345-0@lo:503: Request processed in 153us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841626.496403:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787841626.496442:0:6684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000036612f9f pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:6684:1874687714924416:0@lo:503: 00000040:00080000:2.0:1787841626.496798:0:6684:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787841626.496875:0:6684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000036612f9f pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:6684:1874687714924544:0@lo:502: 00000100:00100000:2.0:1787841626.496911:0:6684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841626.496927:0:6684:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f6ba75a3 going to sleep for 11 seconds 00000100:00100000:2.0:1787841626.496944:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714924544 00000100:00100000:2.0:1787841626.496953:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714924544 00000100:00100000:2.0:1787841626.496979:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787841626.496987:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e8ba6f6f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+11:6684:x1874687714924544:12345-0@lo:502: 00000100:00100000:2.0:1787841626.497123:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e8ba6f6f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+11:6684:x1874687714924544:12345-0@lo:502: Request processed in 138us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841626.497131:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787841626.497174:0:6684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000036612f9f pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:6684:1874687714924544:0@lo:502: 00000040:00080000:2.0:1787841626.497448:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1787841626.497495:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1787841626.497527:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1787841626.497572:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1787841626.497607:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1787841626.497640:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1787841626.497661:0:6684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000036612f9f pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:6684:1874687714924672:0@lo:502: 00000100:00100000:2.0:1787841626.497722:0:6684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841626.497738:0:6684:0:(client.c:2715:ptlrpc_set_wait()) set 0000000019d4feea going to sleep for 11 seconds 00000100:00100000:2.0:1787841626.497753:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714924672 00000100:00100000:2.0:1787841626.497757:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714924672 00000100:00100000:2.0:1787841626.497783:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787841626.497790:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000099efc87 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+11:6684:x1874687714924672:12345-0@lo:502: 00010000:00010000:1.0:1787841626.498021:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787841626.498029:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.101@tcp lock: 0000000048403d16/0xe3dac0c99affe099 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xe3dac0c99affe0a0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841626.498040:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000048403d16 already unused, calling callback (00000000f1e38a88) 10000000:00010000:1.0:1787841626.498043:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.101@tcp lock: 0000000048403d16/0xe3dac0c99affe099 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xe3dac0c99affe0a0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841626.498052:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.101@tcp lock: 0000000048403d16/0xe3dac0c99affe099 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xe3dac0c99affe0a0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787841626.498058:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.101@tcp lock: 0000000048403d16/0xe3dac0c99affe099 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xe3dac0c99affe0a0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787841626.498063:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787841626.498089:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.101@tcp lock: 0000000048403d16/0xe3dac0c99affe099 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xe3dac0c99affe0a0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841626.498106:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787841626.498140:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.101@tcp lock: 0000000048403d16/0xe3dac0c99affe099 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xe3dac0c99affe0a0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841626.498147:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.101@tcp lock: 0000000048403d16/0xe3dac0c99affe099 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xe3dac0c99affe0a0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841626.498162:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841626.498163:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841626.498165:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787841626.498174:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787841626.498187:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009eac637b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3300:1874687714924800:0@lo:103: 00000100:00100000:1.0:1787841626.498224:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841626.498277:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714924800 00000100:00100000:1.0:1787841626.498281:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714924800 00000100:00100000:1.0:1787841626.498316:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787841626.498322:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e3e9266b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+12:3300:x1874687714924800:12345-0@lo:103: 00010000:00010000:1.0:1787841626.498332:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787841626.498349:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000074a1c9bc/0xe3dac0c99affe0a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe3dac0c99affe099 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841626.498363:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787841626.498393:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e3e9266b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+11:3300:x1874687714924800:12345-0@lo:103: Request processed in 72us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841626.498400:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787841626.498431:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009eac637b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3300:1874687714924800:0@lo:103: 00000100:00100000:2.0:1787841626.499024:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000099efc87 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+10:6684:x1874687714924672:12345-0@lo:502: Request processed in 1234us (1300us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841626.499033:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787841626.499144:0:6684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000036612f9f pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:6684:1874687714924672:0@lo:502: 00000040:00080000:0.0:1787841626.499297:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1787841626.499315:0:6684:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:0.0:1787841626.500451:0:6702:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787841626.500465:0:6702:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1787841626.500474:0:6702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787841626.500476:0:6702:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1787841626.500482:0:6702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787841626.500502:0:6702:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (00000000e71a1022) 00000020:00000080:0.0:1787841626.500553:0:6702:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787841626.500561:0:6702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787841626.501420:0:6702:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000090912882 from lustre-OST0000, refs=2 00080000:01000000:0.0:1787841626.501434:0:6702:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787841626.501454:0:6702:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xe3dac0c99affe0ca 00010000:00010000:1.0:1787841626.505989:0:6702:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:1.0:1787841626.506454:0:6702:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:1.0:1787841626.510397:0:6702:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1787841626.510901:0:6702:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:0.0:1787841626.518660:0:6702:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1787841626.519229:0:6702:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1787841626.520865:0:6702:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1787841626.520881:0:6702:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787841626.520890:0:6702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787841626.520892:0:6702:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1787841626.520895:0:6702:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787841626.520899:0:6702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787841626.520900:0:6702:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787841626.520903:0:6702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787841626.520905:0:6702:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787841626.520973:0:6702:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787841626.520977:0:6702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787841626.520978:0:6702:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787841626.520981:0:6702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1787841626.521314:0:6684:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1787841626.521348:0:6684:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1787841626.521375:0:6684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: 0000000078c17dcc/0xe3dac0c99affe0b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe0bc expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841626.521391:0:6684:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: 0000000078c17dcc/0xe3dac0c99affe0b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe0bc expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787841626.521399:0:6684:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92cbf04e3800 from 1 10000000:01000000:3.0:1787841626.521402:0:6684:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787841626.521452:0:6684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: 0000000015e2fd2d/0xe3dac0c99affe0d1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841626.521459:0:6684:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: 0000000015e2fd2d/0xe3dac0c99affe0d1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841626.521471:0:6684:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: 0000000015e2fd2d/0xe3dac0c99affe0d1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841626.521499:0:6684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f69fb54d pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:6684:1874687714924928:0@lo:101: 00000100:00100000:3.0:1787841626.521603:0:6684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841626.521666:0:6684:0:(client.c:2715:ptlrpc_set_wait()) set 0000000080c6823b going to sleep for 11 seconds 00000100:00100000:3.0:1787841626.521842:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714924928 00000100:00100000:3.0:1787841626.521851:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714924928 00000100:00100000:3.0:1787841626.521910:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787841626.521919:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000009df2279 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+10:6684:x1874687714924928:12345-0@lo:101: 00010000:00010000:3.0:1787841626.521936:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841626.521951:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000df6d90df/0xe3dac0c99affe0d8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe3dac0c99affe0d1 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841626.521978:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000df6d90df/0xe3dac0c99affe0d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe3dac0c99affe0d1 expref: 11 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841626.521988:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000df6d90df/0xe3dac0c99affe0d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe3dac0c99affe0d1 expref: 11 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841626.521997:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000df6d90df, rc 0) 00000100:00100000:3.0:1787841626.522066:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000009df2279 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+11:6684:x1874687714924928:12345-0@lo:101: Request processed in 148us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841626.522073:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787841626.522131:0:6684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f69fb54d pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:6684:1874687714924928:0@lo:101: 00010000:00010000:3.0:1787841626.522147:0:6684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: 0000000015e2fd2d/0xe3dac0c99affe0d1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe0d8 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841626.522155:0:6684:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: 0000000015e2fd2d/0xe3dac0c99affe0d1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe3dac0c99affe0d8 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841626.522261:0:6684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f69fb54d pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:6684:1874687714925056:0@lo:501: 00000100:00100000:3.0:1787841626.522288:0:6684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841626.522303:0:6684:0:(client.c:2715:ptlrpc_set_wait()) set 0000000080c6823b going to sleep for 11 seconds 00000100:00100000:3.0:1787841626.522915:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714925056 00000100:00100000:3.0:1787841626.522933:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714925056 00000100:00100000:3.0:1787841626.522974:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787841626.522981:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000eebe709 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+11:6684:x1874687714925056:12345-0@lo:501: 00000100:00100000:3.0:1787841626.523261:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000eebe709 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+11:6684:x1874687714925056:12345-0@lo:501: Request processed in 280us (972us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841626.523268:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787841626.523307:0:6684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f69fb54d pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:6684:1874687714925056:0@lo:501: 00000100:00100000:3.0:1787841626.523343:0:6684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f69fb54d pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:6684:1874687714925184:0@lo:503: 00000100:00100000:3.0:1787841626.523384:0:6684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841626.523407:0:6684:0:(client.c:2715:ptlrpc_set_wait()) set 0000000080c6823b going to sleep for 11 seconds 00000100:00100000:3.0:1787841626.523420:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714925184 00000100:00100000:3.0:1787841626.523423:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714925184 00000100:00100000:3.0:1787841626.523441:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787841626.523445:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fecbd2f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+11:6684:x1874687714925184:12345-0@lo:503: 00000100:00100000:2.0:1787841626.531760:0:6684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f69fb54d pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:6684:1874687714925184:0@lo:503: 00000100:00100000:3.0:1787841626.532242:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fecbd2f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+11:6684:x1874687714925184:12345-0@lo:503: Request processed in 8793us (8856us total) trans 0 rc 0/0 00000040:00080000:2.0:1787841626.532252:0:6684:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787841626.532257:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787841626.532368:0:6684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b9dde5b4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:6684:1874687714925312:0@lo:502: 00000100:00100000:2.0:1787841626.532426:0:6684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841626.532484:0:6684:0:(client.c:2715:ptlrpc_set_wait()) set 000000000ec06662 going to sleep for 11 seconds 00000100:00100000:3.0:1787841626.532509:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714925312 00000100:00100000:3.0:1787841626.532517:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714925312 00000100:00100000:3.0:1787841626.532566:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787841626.532576:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d00f4512 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+11:6684:x1874687714925312:12345-0@lo:502: 00000100:00100000:3.0:1787841626.532921:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d00f4512 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+11:6684:x1874687714925312:12345-0@lo:502: Request processed in 346us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841626.532929:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787841626.533226:0:6684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b9dde5b4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:6684:1874687714925312:0@lo:502: 00000040:00080000:2.0:1787841626.533504:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1787841626.533563:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1787841626.533608:0:6684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b9dde5b4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:6684:1874687714925440:0@lo:502: 00000100:00100000:2.0:1787841626.533650:0:6684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841626.533688:0:6684:0:(client.c:2715:ptlrpc_set_wait()) set 000000000ec06662 going to sleep for 11 seconds 00000100:00100000:3.0:1787841626.534294:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714925440 00000100:00100000:3.0:1787841626.534301:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714925440 00000100:00100000:3.0:1787841626.534350:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787841626.534367:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b12192c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+11:6684:x1874687714925440:12345-0@lo:502: 00000100:00100000:3.0:1787841626.534557:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b12192c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+11:6684:x1874687714925440:12345-0@lo:502: Request processed in 192us (906us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841626.534564:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787841626.534688:0:6684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b9dde5b4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:6684:1874687714925440:0@lo:502: 00000040:00080000:2.0:1787841626.534846:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1787841626.534860:0:6684:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1787841626.535671:0:6706:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787841626.535684:0:6706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787841626.535687:0:6706:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787841626.535694:0:6706:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff92cbf04e3800 00000020:00000080:1.0:1787841626.535712:0:6706:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787841626.535762:0:6706:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787841626.535766:0:6706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787841626.535768:0:6706:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1787841626.535771:0:6706:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1787841626.538847:0:6684:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1787841626.538918:0:6684:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787841626.538964:0:6684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc149cc00/0xe3dac0c99affe0d1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe0d8 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841626.538981:0:6684:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff92cbc149cc00/0xe3dac0c99affe0d1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe0d8 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787841626.539044:0:6684:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787841626.539047:0:6684:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff92cbf04e3800 10000000:01000000:2.0:1787841626.539051:0:6684:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff92cbf04e3800 10000000:01000000:2.0:1787841626.539056:0:6684:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787841626.539064:0:6684:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff92cbf04e3800 from 1 10000000:01000000:2.0:1787841626.539067:0:6684:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787841626.539122:0:6684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc13a2c00/0xe3dac0c99affe0df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841626.539131:0:6684:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff92cbc13a2c00/0xe3dac0c99affe0df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841626.539156:0:6684:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff92cbc13a2c00/0xe3dac0c99affe0df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841626.539187:0:6684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4a9f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:6684:1874687714925568:0@lo:101: 00000100:00100000:2.0:1787841626.539281:0:6684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841626.539325:0:6684:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbd1fe7540 going to sleep for 11 seconds 00000100:00100000:3.0:1787841626.539775:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714925568 00000100:00100000:3.0:1787841626.539784:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714925568 00000100:00100000:3.0:1787841626.539843:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787841626.539854:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+11:6684:x1874687714925568:12345-0@lo:101: 00010000:00010000:3.0:1787841626.539870:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841626.539888:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92cbc149c400/0xe3dac0c99affe0e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe3dac0c99affe0df expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841626.539920:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92cbc149c400/0xe3dac0c99affe0e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe3dac0c99affe0df expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841626.539931:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92cbc149c400/0xe3dac0c99affe0e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe3dac0c99affe0df expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841626.539940:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc149c400, rc 0) 00000100:00100000:3.0:1787841626.540005:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+12:6684:x1874687714925568:12345-0@lo:101: Request processed in 152us (724us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841626.540012:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787841626.540840:0:6684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4a9f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:6684:1874687714925568:0@lo:101: 00010000:00010000:2.0:1787841626.540863:0:6684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff92cbc13a2c00/0xe3dac0c99affe0df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe0e6 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841626.540874:0:6684:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff92cbc13a2c00/0xe3dac0c99affe0df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe3dac0c99affe0e6 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841626.541041:0:6684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4a9f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:6684:1874687714925696:0@lo:501: 00000100:00100000:2.0:1787841626.541089:0:6684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841626.541117:0:6684:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbd1fe7540 going to sleep for 11 seconds 00000100:00100000:3.0:1787841626.541276:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714925696 00000100:00100000:3.0:1787841626.541283:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714925696 00000100:00100000:3.0:1787841626.541330:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787841626.541339:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+12:6684:x1874687714925696:12345-0@lo:501: 00000100:00100000:3.0:1787841626.541653:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+12:6684:x1874687714925696:12345-0@lo:501: Request processed in 315us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841626.541870:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787841626.542399:0:6684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4a9f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:6684:1874687714925696:0@lo:501: 00000100:00100000:2.0:1787841626.542445:0:6684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4a9f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:6684:1874687714925824:0@lo:503: 00000100:00100000:2.0:1787841626.542499:0:6684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841626.542526:0:6684:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbd1fe7540 going to sleep for 11 seconds 00000100:00100000:3.0:1787841626.543478:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714925824 00000100:00100000:3.0:1787841626.543487:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714925824 00000100:00100000:3.0:1787841626.543531:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787841626.543541:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+12:6684:x1874687714925824:12345-0@lo:503: 00000100:00100000:3.0:1787841626.544407:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+12:6684:x1874687714925824:12345-0@lo:503: Request processed in 862us (1903us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841626.544428:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787841626.544529:0:6684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4a9f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:6684:1874687714925824:0@lo:503: 00000040:00080000:2.0:1787841626.545522:0:6684:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787841626.545655:0:6684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4a9f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:6684:1874687714925952:0@lo:502: 00000100:00100000:2.0:1787841626.545756:0:6684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841626.545811:0:6684:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbd1fe7540 going to sleep for 11 seconds 00000100:00100000:0.0:1787841626.547101:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714925952 00000100:00100000:0.0:1787841626.547115:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714925952 00000100:00100000:0.0:1787841626.547191:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787841626.547203:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+12:6684:x1874687714925952:12345-0@lo:502: 00000100:00100000:0.0:1787841626.547532:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+12:6684:x1874687714925952:12345-0@lo:502: Request processed in 330us (1775us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841626.547541:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787841626.547937:0:6684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4a9f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:6684:1874687714925952:0@lo:502: 00000040:00080000:2.0:1787841626.548306:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1787841626.548370:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1787841626.548403:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1787841626.548444:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1787841626.548466:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1787841626.548511:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1787841626.548545:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1787841626.549841:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1787841626.550008:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1787841626.550044:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1787841626.550073:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1787841626.550122:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1787841626.550172:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1787841626.551055:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1787841626.551226:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1787841626.551284:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1787841626.551309:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1787841626.551337:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1787841626.551355:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1787841626.551372:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1787841626.551395:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1787841626.551413:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1787841626.551429:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1787841626.551452:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1787841626.551469:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1787841626.551485:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1787841626.551509:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1787841626.551526:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:2.0:1787841626.551581:0:6684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4a9f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:6684:1874687714926080:0@lo:502: 00000100:00100000:2.0:1787841626.551688:0:6684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841626.551773:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714926080 00000100:00100000:2.0:1787841626.551775:0:6684:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbd1fe7540 going to sleep for 11 seconds 00000100:00100000:3.0:1787841626.551782:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714926080 00000100:00100000:3.0:1787841626.551851:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787841626.551862:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+12:6684:x1874687714926080:12345-0@lo:502: 00000100:00100000:3.0:1787841626.552135:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+12:6684:x1874687714926080:12345-0@lo:502: Request processed in 275us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841626.552144:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787841626.552402:0:6684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4a9f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:6684:1874687714926080:0@lo:502: 00000040:00080000:2.0:1787841626.552476:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1787841626.552486:0:6684:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:2.0:1787841626.553323:0:6707:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1787841626.553341:0:6707:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff92cbe9989a48) 00000020:00000080:2.0:1787841626.553362:0:6707:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:2.0:1787841626.553446:0:6707:0:(tgt_mount.c:153:server_get_mount()) get mount ffff92cbf04e3800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787841626.553449:0:6707:0:(tgt_mount.c:187:server_put_mount()) put mount ffff92cbf04e3800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787841626.553451:0:6707:0:(obd_mount.c:710:lustre_put_lsi()) put ffff92cbf04e3800 3 00010000:00080000:2.0:1787841626.553484:0:6707:0:(ldlm_lib.c:102:import_set_conn()) imp ffff92cbf7350000@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.101@tcp at head 00010000:00010000:2.0:1787841626.555138:0:6707:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:2.0:1787841626.555462:0:6707:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1787841626.555502:0:6707:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787841626.555518:0:6707:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xe3dac0c99affe0f4 00000100:00080000:2.0:1787841626.555530:0:6707:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787841626.555537:0:6707:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff92cbf7350000 using connection 192.168.201.101@tcp/0@lo 00000100:00100000:2.0:1787841626.555584:0:6707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92cbd4a9f0c0 x1874687714926208/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787841626.555617:0:6707:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787841626.555764:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbc3dcda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874687714926336:0@lo:400: 00000100:00100000:0.0:1787841626.555878:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841626.555955:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714926336 00000100:00100000:2.0:1787841626.555963:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714926336 00000100:00100000:2.0:1787841626.556012:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787841626.556022:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbc3dcf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874687714926336:12345-0@lo:400: 00000100:00100000:2.0:1787841626.556091:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbc3dcf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874687714926336:12345-0@lo:400: Request processed in 70us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841626.556098:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787841626.556138:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff92cbc3dcda40 x1874687714926336/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787841642 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787841626.556159:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbc3dcda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874687714926336:0@lo:400: 00000100:00100000:3.0:1787841626.556849:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4a9f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3297:1874687714926208:0@lo:38: 00000100:00100000:3.0:1787841626.556898:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:0.0:1787841626.557141:0:6707:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000100:00100000:2.0:1787841626.557234:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714926208 00000100:00100000:2.0:1787841626.557241:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714926208 00000100:00100000:2.0:1787841626.557283:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787841626.557291:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbd4bafc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3297:x1874687714926208:12345-0@lo:38: 00010000:00080000:2.0:1787841626.557324:0:5838:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 166 last 0 00000020:01000000:3.0:1787841626.557342:0:6684:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 00000020:00000080:2.0:1787841626.557368:0:5838:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xe3dac0c99affe0fb 10000000:01000000:3.0:1787841626.557371:0:6684:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'lustre-client' succeeded (0). 00000004:00100000:2.0:1787841626.557393:0:5838:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00010000:00010000:3.0:1787841626.557397:0:6684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc13a2c00/0xe3dac0c99affe0df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe0e6 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841626.557408:0:6684:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff92cbc13a2c00/0xe3dac0c99affe0df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe0e6 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787841626.557458:0:6684:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787841626.557461:0:6684:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787841626.557468:0:6684:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787841626.557469:0:6684:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787841626.557470:0:6684:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787841626.557472:0:6684:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787841626.557473:0:6684:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787841626.557476:0:6684:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787841626.557477:0:6684:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787841626.557479:0:6684:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787841626.557480:0:6684:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787841626.557485:0:6684:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:3.0:1787841626.557488:0:6684:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787841626.557489:0:6684:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787841626.557490:0:6684:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787841626.557491:0:6684:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787841626.557492:0:6684:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787841626.557493:0:6684:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787841626.557494:0:6684:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787841626.557494:0:6684:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787841626.557495:0:6684:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787841626.557496:0:6684:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787841626.557497:0:6684:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787841626.557520:0:6684:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1787841626.557536:0:6684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4baed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:6684:1874687714926464:0@lo:253: 00000100:00080000:2.0:1787841626.558133:0:5838:0:(import.c:65:import_set_state_nolock()) ffff92cbffa02000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787841626.558212:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbd4bafc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1874687714926208:12345-0@lo:38: Request processed in 919us (1312us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841626.558220:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787841626.558271:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff92cbd4a9f0c0 x1874687714926208/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787841636 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787841626.558282:0:3297:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787841626.558291:0:3297:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1787841626.558300:0:3297:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787841626.558306:0:3297:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787841626.558308:0:3297:0:(import.c:65:import_set_state_nolock()) ffff92cbf7350000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787841626.558314:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4a9f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3297:1874687714926208:0@lo:38: 00000100:00100000:3.0:1787841626.561444:0:6684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841626.561517:0:6684:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc8ff3600 going to sleep for 11 seconds 00000100:00100000:0.0:1787841626.562326:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714926464 00000100:00100000:0.0:1787841626.562339:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714926464 00000100:00100000:0.0:1787841626.562405:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787841626.562419:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+12:6684:x1874687714926464:12345-0@lo:253: 20000000:01000000:0.0:1787841626.562467:0:5833:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787841626.562483:0:5833:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787841626.598781:0:5833:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787841626.598851:0:5833:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1787841626.600158:0:5853:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787841626.600167:0:5853:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787841626.600200:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff92cbc149c600/0xe3dac0c99affe102 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841626.600225:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92cbc6725400/0xe3dac0c99affe06f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe3dac0c99affe068 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841626.600234:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff92cbc149c600/0xe3dac0c99affe102 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841626.600290:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92cbc6725400/0xe3dac0c99affe06f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe3dac0c99affe068 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841626.600326:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92cbc6725400/0xe3dac0c99affe06f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe3dac0c99affe068 expref: 12 pid: 5831 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841626.600345:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4bad2c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5853:1874687714926592:0@lo:104: 00000100:00100000:3.0:1787841626.600449:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841626.600527:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc8ff3000 going to sleep for 11 seconds 00000100:00100000:0.0:1787841626.600659:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714926592 00000100:00100000:0.0:1787841626.600668:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714926592 00000100:00100000:0.0:1787841626.600751:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787841626.600762:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbd4bac780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+3:5853:x1874687714926592:12345-0@lo:104: 00010000:00010000:0.0:1787841626.600778:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.101@tcp lock: ffff92cbc149d600/0xe3dac0c99affe068 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe3dac0c99affe06f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841626.600861:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787841626.600868:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbd4bac780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+3:5853:x1874687714926592:12345-0@lo:104: Request processed in 109us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841626.600876:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787841626.600899:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4bad2c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5853:1874687714926592:0@lo:104: 00010000:00010000:0.0:1787841626.600913:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787841626.600920:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.101@tcp lock: ffff92cbc149d600/0xe3dac0c99affe068 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe3dac0c99affe06f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841626.600925:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff92cbc149c600/0xe3dac0c99affe102 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841626.600928:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc149d600 already unused, calling callback (ffffffffc1d9fc20) 10000000:00010000:0.0:1787841626.600932:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.101@tcp lock: ffff92cbc149d600/0xe3dac0c99affe068 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe3dac0c99affe06f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841626.600941:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.101@tcp lock: ffff92cbc149d600/0xe3dac0c99affe068 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe3dac0c99affe06f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787841626.600949:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.101@tcp lock: ffff92cbc149d600/0xe3dac0c99affe068 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe3dac0c99affe06f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787841626.600955:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787841626.601006:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.101@tcp lock: ffff92cbc149d600/0xe3dac0c99affe068 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99affe06f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841626.601012:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787841626.601033:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.101@tcp lock: ffff92cbc149d600/0xe3dac0c99affe068 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99affe06f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841626.601040:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.101@tcp lock: ffff92cbc149d600/0xe3dac0c99affe068 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99affe06f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841626.601059:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841626.601061:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841626.601063:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787841626.601077:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbc3dccf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3299:1874687714926720:0@lo:103: 10000000:01000000:2.0:1787841626.601081:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787841626.601092:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff92cbc3ed8000 from 21 10000000:01000000:2.0:1787841626.601096:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00000100:00100000:0.0:1787841626.601116:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787841626.601118:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc13a3c00/0xe3dac0c99affe109 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841626.601126:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff92cbc13a3c00/0xe3dac0c99affe109 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841626.601135:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff92cbc13a3c00/0xe3dac0c99affe109 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841626.601159:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4a9f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714926848:0@lo:101: 00000100:00100000:2.0:1787841626.601201:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841626.601224:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbf0462d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787841626.601296:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714926720 00000100:00100000:1.0:1787841626.601302:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714926720 00000100:00100000:0.0:1787841626.601337:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714926848 00000100:00100000:0.0:1787841626.601342:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714926848 00010000:00010000:1.0:1787841626.601344:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92cbc6725400/0xe3dac0c99affe06f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe3dac0c99affe068 expref: 13 pid: 5831 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841626.601366:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787841626.601372:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787841626.601373:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+14:5836:x1874687714926848:12345-0@lo:101: 00000100:00100000:1.0:1787841626.601377:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcdb7e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+14:3299:x1874687714926720:12345-0@lo:103: 00010000:00010000:1.0:1787841626.601389:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787841626.601389:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841626.601394:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92cbc6725400/0xe3dac0c99affe06f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe3dac0c99affe068 expref: 14 pid: 5831 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841626.601401:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92cbc6725c00/0xe3dac0c99affe110 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe3dac0c99affe109 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841626.601404:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92cbc6725400/0xe3dac0c99affe06f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe3dac0c99affe068 expref: 14 pid: 5831 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841626.601416:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92cbc6725400/0xe3dac0c99affe06f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe3dac0c99affe068 expref: 15 pid: 5831 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841626.601421:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92cbc6725c00/0xe3dac0c99affe110 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe3dac0c99affe109 expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841626.601428:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff92cbc149c600/0xe3dac0c99affe102 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841626.601431:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92cbc6725c00/0xe3dac0c99affe110 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe3dac0c99affe109 expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841626.601440:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc6725c00, rc 0) 00010000:00010000:1.0:1787841626.601445:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92cbc149c600/0xe3dac0c99affe102 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787841626.601457:0:5825:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002908681s 00010000:00010000:1.0:1787841626.601462:0:5825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92cbc149c600/0xe3dac0c99affe102 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841626.601470:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92cbc149c600/0xe3dac0c99affe102 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841626.601476:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+14:5836:x1874687714926848:12345-0@lo:101: Request processed in 103us (275us total) trans 0 rc 0/0 00010000:00010000:1.0:1787841626.601478:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff92cbc149c600/0xe3dac0c99affe102 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841626.601481:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00010000:1.0:1787841626.601485:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff92cbc149c600/0xe3dac0c99affe102 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841626.601490:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc149c600 already unused, calling callback (ffffffffc17a4500) 00010000:00010000:1.0:1787841626.601495:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff92cbc149c600/0xe3dac0c99affe102 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841626.601502:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff92cbc149c600/0xe3dac0c99affe102 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841626.601517:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff92cbc149c600/0xe3dac0c99affe102 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841626.601517:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4a9f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714926848:0@lo:101: 00010000:00010000:1.0:1787841626.601526:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787841626.601541:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff92cbc13a3c00/0xe3dac0c99affe109 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe110 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841626.601549:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff92cbc13a3c00/0xe3dac0c99affe109 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe3dac0c99affe110 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841626.601556:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcdb7e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+13:3299:x1874687714926720:12345-0@lo:103: Request processed in 180us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841626.601562:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787841626.601612:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbc3dcf0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714926976:0@lo:501: 00000100:00100000:0.0:1787841626.601637:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841626.601650:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbd14e3f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787841626.601680:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714926976 00000100:00100000:2.0:1787841626.601685:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714926976 00000100:00100000:2.0:1787841626.601728:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787841626.601736:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+14:5836:x1874687714926976:12345-0@lo:501: 00000100:00100000:0.0:1787841626.601852:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbc3dccf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3299:1874687714926720:0@lo:103: 00000100:00100000:2.0:1787841626.602062:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+14:5836:x1874687714926976:12345-0@lo:501: Request processed in 326us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841626.602069:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00010000:1.0:1787841626.602625:0:5853:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff92cbc149c600/0xe3dac0c99affe102 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841626.602636:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff92cbc149c600/0xe3dac0c99affe102 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841626.602643:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92cbc149c600/0xe3dac0c99affe102 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841626.605258:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbc3dcf0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714926976:0@lo:501: 00000100:00100000:0.0:1787841626.605337:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbc3dcf0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714927104:0@lo:503: 00000100:00100000:0.0:1787841626.605443:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841626.605491:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbd14e3f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787841626.605952:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714927104 00000100:00100000:2.0:1787841626.605962:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714927104 00000100:00100000:2.0:1787841626.606031:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787841626.606042:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+13:5836:x1874687714927104:12345-0@lo:503: 00000100:00100000:2.0:1787841626.606291:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+13:5836:x1874687714927104:12345-0@lo:503: Request processed in 249us (847us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841626.606299:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787841626.606442:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbc3dcf0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714927104:0@lo:503: 00000100:00100000:3.0:1787841626.607171:0:6710:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4bada40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f6e7591a-84a0-4774-9d28-b3ed28591dc5:6710:1874687714927232:0@lo:502: 00000100:00100000:3.0:1787841626.607226:0:6710:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841626.607266:0:6710:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc8ff3840 going to sleep for 11 seconds 00000100:00100000:2.0:1787841626.607322:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714927232 00000100:00100000:2.0:1787841626.607334:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714927232 00000100:00100000:2.0:1787841626.607374:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787841626.607383:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+13:6710:x1874687714927232:12345-0@lo:502: 00000100:00100000:2.0:1787841626.607900:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+13:6710:x1874687714927232:12345-0@lo:502: Request processed in 517us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841626.607909:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787841626.608159:0:6710:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4bada40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f6e7591a-84a0-4774-9d28-b3ed28591dc5:6710:1874687714927232:0@lo:502: 00000100:00100000:3.0:1787841626.608215:0:6710:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4bada40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f6e7591a-84a0-4774-9d28-b3ed28591dc5:6710:1874687714927360:0@lo:502: 00000100:00100000:3.0:1787841626.608253:0:6710:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841626.608288:0:6710:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc8ff3840 going to sleep for 11 seconds 00000100:00100000:2.0:1787841626.608346:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714927360 00000100:00100000:2.0:1787841626.608352:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714927360 00000100:00100000:2.0:1787841626.608391:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787841626.608399:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+13:6710:x1874687714927360:12345-0@lo:502: 00000100:00100000:2.0:1787841626.608566:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+13:6710:x1874687714927360:12345-0@lo:502: Request processed in 167us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841626.608574:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787841626.608622:0:6710:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4bada40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f6e7591a-84a0-4774-9d28-b3ed28591dc5:6710:1874687714927360:0@lo:502: 00000040:00080000:2.0:1787841626.608642:0:6710:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:3.0:1787841626.609079:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:3.0:1787841626.609112:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787841626.609125:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc13a3c00/0xe3dac0c99affe109 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe110 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841626.609137:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff92cbc13a3c00/0xe3dac0c99affe109 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe110 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787841626.609147:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787841626.609151:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff92cbc3ed8000 from 4 10000000:01000000:3.0:1787841626.609154:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787841626.609186:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc149c200/0xe3dac0c99affe117 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841626.609207:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff92cbc149c200/0xe3dac0c99affe117 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841626.609217:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff92cbc149c200/0xe3dac0c99affe117 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841626.609231:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4bad680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714927488:0@lo:101: 00000100:00100000:3.0:1787841626.609263:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841626.609291:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc8ff3840 going to sleep for 11 seconds 00000100:00100000:2.0:1787841626.609337:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714927488 00000100:00100000:2.0:1787841626.609343:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714927488 00000100:00100000:2.0:1787841626.609377:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787841626.609384:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+13:5836:x1874687714927488:12345-0@lo:101: 00010000:00010000:2.0:1787841626.609395:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841626.609410:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92cbc13a3000/0xe3dac0c99affe11e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe3dac0c99affe117 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841626.609443:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92cbc13a3000/0xe3dac0c99affe11e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe3dac0c99affe117 expref: 14 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841626.609456:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92cbc13a3000/0xe3dac0c99affe11e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe3dac0c99affe117 expref: 14 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841626.609478:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc13a3000, rc 0) 00000100:00100000:0.0:1787841626.609774:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4bad680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714927488:0@lo:101: 00010000:00010000:0.0:1787841626.609791:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff92cbc149c200/0xe3dac0c99affe117 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe11e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841626.609810:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff92cbc149c200/0xe3dac0c99affe117 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe3dac0c99affe11e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841626.609824:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+14:5836:x1874687714927488:12345-0@lo:101: Request processed in 439us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841626.609831:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787841626.609861:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbc3dccf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714927616:0@lo:256: 00000100:00100000:0.0:1787841626.609903:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841626.609931:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbd14e3f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787841626.611011:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714927616 00000100:00100000:3.0:1787841626.611025:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714927616 00000100:00100000:3.0:1787841626.611090:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787841626.611100:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+14:5836:x1874687714927616:12345-0@lo:256: 20000000:01000000:3.0:1787841626.611125:0:5832:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787841626.611151:0:5832:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787841626.611155:0:5832:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1787841626.611295:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+14:5836:x1874687714927616:12345-0@lo:256: Request processed in 196us (1392us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841626.611304:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787841626.611388:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbc3dccf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714927616:0@lo:256: 10000000:01000000:0.0:1787841626.611444:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787841626.611456:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc149c200/0xe3dac0c99affe117 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe11e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841626.611467:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff92cbc149c200/0xe3dac0c99affe117 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe11e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787841626.611476:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1787841626.611479:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1787841626.611482:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787841626.611518:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc6725200/0xe3dac0c99affe125 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841626.611526:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff92cbc6725200/0xe3dac0c99affe125 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841626.611535:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff92cbc6725200/0xe3dac0c99affe125 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841626.611554:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbc3dccf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714927744:0@lo:101: 00000100:00100000:0.0:1787841626.611591:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841626.611630:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbd14e3f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787841626.611668:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714927744 00000100:00100000:3.0:1787841626.611673:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714927744 00000100:00100000:3.0:1787841626.611760:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787841626.611768:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+14:5836:x1874687714927744:12345-0@lo:101: 00010000:00010000:3.0:1787841626.611779:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841626.611794:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92cbc149d600/0xe3dac0c99affe12c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe3dac0c99affe125 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841626.611829:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92cbc149d600/0xe3dac0c99affe12c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe3dac0c99affe125 expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841626.611848:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92cbc149d600/0xe3dac0c99affe12c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe3dac0c99affe125 expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841626.611858:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc149d600, rc 0) 00000100:00100000:3.0:1787841626.611897:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+15:5836:x1874687714927744:12345-0@lo:101: Request processed in 130us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841626.611904:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787841626.611981:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbc3dccf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714927744:0@lo:101: 00010000:00010000:0.0:1787841626.611996:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff92cbc6725200/0xe3dac0c99affe125 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe12c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841626.612015:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff92cbc6725200/0xe3dac0c99affe125 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe3dac0c99affe12c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841626.612072:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbc3dccf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714927872:0@lo:501: 00000100:00100000:0.0:1787841626.612099:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841626.616284:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbd14e3f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787841626.621317:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714927872 00000100:00100000:2.0:1787841626.621358:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714927872 00000100:00100000:2.0:1787841626.621501:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787841626.621528:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+15:5836:x1874687714927872:12345-0@lo:501: 00000100:00100000:1.0:1787841626.621549:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+15:6684:x1874687714926464:12345-0@lo:253: Request processed in 59132us (60113us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841626.621558:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787841626.621688:0:6684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4baed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:6684:1874687714926464:0@lo:253: 10000000:01000000:0.0:1787841626.621729:0:6684:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1787841626.621733:0:6684:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787841626.621735:0:6684:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787841626.621736:0:6684:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787841626.621737:0:6684:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787841626.621739:0:6684:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787841626.621740:0:6684:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787841626.621742:0:6684:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787841626.621744:0:6684:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787841626.621745:0:6684:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787841626.621747:0:6684:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787841626.621749:0:6684:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787841626.621778:0:6684:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1787841626.624243:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+14:5836:x1874687714927872:12345-0@lo:501: Request processed in 2717us (12130us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841626.624346:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787841626.624791:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbc3dccf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714927872:0@lo:501: 00000100:00100000:1.0:1787841626.624877:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4bb03c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714928000:0@lo:503: 00000100:00100000:1.0:1787841626.624952:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841626.624999:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbd0b1f000 going to sleep for 11 seconds 00000100:00100000:2.0:1787841626.625204:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714928000 00000100:00100000:2.0:1787841626.625224:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714928000 00000100:00100000:2.0:1787841626.625318:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787841626.625330:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+14:5836:x1874687714928000:12345-0@lo:503: 00000100:00100000:2.0:1787841626.625819:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+14:5836:x1874687714928000:12345-0@lo:503: Request processed in 490us (866us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841626.625827:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787841626.625862:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4bb03c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714928000:0@lo:503: 00000100:00100000:3.0:1787841626.635038:0:6711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4bae1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f6e7591a-84a0-4774-9d28-b3ed28591dc5:6711:1874687714928128:0@lo:502: 00000100:00100000:3.0:1787841626.635167:0:6711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841626.635227:0:6711:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc8ff3540 going to sleep for 11 seconds 00000100:00100000:2.0:1787841626.635336:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714928128 00000100:00100000:2.0:1787841626.635347:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714928128 00000100:00100000:2.0:1787841626.635412:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787841626.635423:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+14:6711:x1874687714928128:12345-0@lo:502: 00000100:00100000:2.0:1787841626.635819:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+14:6711:x1874687714928128:12345-0@lo:502: Request processed in 397us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841626.635829:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00080000:10000000:1.0:1787841626.637190:0:6684:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1787841626.637379:0:6684:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1787841626.638209:0:6684:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1787841626.638409:0:6684:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00000100:00100000:0.0:1787841626.638817:0:6711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4bae1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f6e7591a-84a0-4774-9d28-b3ed28591dc5:6711:1874687714928128:0@lo:502: 00000020:01000000:0.0:1787841626.638874:0:6711:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787841626.638884:0:6711:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00080000:10000000:1.0:1787841626.639133:0:6684:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1787841626.639379:0:6684:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000020:00000080:0.0:1787841626.642943:0:6711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787841626.642956:0:6711:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1787841626.642976:0:6711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787841626.642983:0:6711:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.101@tcp to nid 0x20000c0a8c965 (192.168.201.101@tcp) 00000020:01000000:0.0:1787841626.643022:0:6711:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787841626.643025:0:6711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787841626.643078:0:6711:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff92cbffa43490) 00000020:00000080:0.0:1787841626.643116:0:6711:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:0.0:1787841626.643125:0:6711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787841626.643253:0:6711:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1787841626.643262:0:6711:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:0.0:1787841626.643269:0:6711:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe3dac0c99affe13a 00010000:00080000:0.0:1787841626.643311:0:6711:0:(ldlm_lib.c:102:import_set_conn()) imp ffff92cbff5b2800@lustre-OST0000-osc-MDT0000: add connection 192.168.201.101@tcp at head 00010000:00010000:0.0:1787841626.643932:0:6711:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000001:00000004:0.0:1787841626.652041:0:6684:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:1.0:1787841626.690225:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1787841626.735982:0:6711:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1787841626.736016:0:6711:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1787841626.739395:0:6711:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787841626.740153:0:6711:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787841626.740224:0:6711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1787841626.740293:0:6711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1787841626.752182:0:6713:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787841626.752196:0:6713:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1787841626.763822:0:6711:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787841626.763842:0:6711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787841626.763898:0:6711:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1787841626.763924:0:6711:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe3dac0c99affe141 00000100:00080000:1.0:1787841626.763938:0:6711:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787841626.763946:0:6711:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff92cbff5b2800 using connection 192.168.201.101@tcp/0@lo 00000100:00100000:1.0:1787841626.763991:0:6711:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92cbd4bb03c0 x1874687714928256/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787841626.764016:0:6711:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1787841626.764097:0:6711:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787841626.764102:0:6711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787841626.764104:0:6711:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1787841626.764107:0:6711:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787841626.764112:0:6711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787841626.764114:0:6711:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787841626.764117:0:6711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787841626.764119:0:6711:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1787841626.764155:0:6711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4bb0780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f6e7591a-84a0-4774-9d28-b3ed28591dc5:6711:1874687714928384:0@lo:502: 00000100:00100000:1.0:1787841626.766109:0:6711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841626.766188:0:6711:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbe76b4600 going to sleep for 11 seconds 00000100:00100000:1.0:1787841626.766232:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4bb03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1874687714928256:0@lo:8: 00000100:00100000:1.0:1787841626.768357:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841626.768463:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714928384 00000100:00100000:1.0:1787841626.768475:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714928384 00000100:00100000:1.0:1787841626.768538:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787841626.768550:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+14:6711:x1874687714928384:12345-0@lo:502: 00000100:00100000:1.0:1787841626.771896:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+14:6711:x1874687714928384:12345-0@lo:502: Request processed in 3334us (5785us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841626.771917:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787841626.772024:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714928256 00000100:00100000:1.0:1787841626.772035:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714928256 00000100:00100000:1.0:1787841626.772096:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787841626.772104:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbd4bb1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3297:x1874687714928256:12345-0@lo:8: 00000100:00100000:1.0:1787841626.772177:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbd4bb1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3297:x1874687714928256:12345-0@lo:8: Request processed in 73us (5889us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787841626.772185:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787841626.772236:0:6711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4bb0780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f6e7591a-84a0-4774-9d28-b3ed28591dc5:6711:1874687714928384:0@lo:502: 00000020:01000000:1.0:1787841626.772286:0:6711:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787841626.772296:0:6711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787841626.772298:0:6711:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787841626.772304:0:6711:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:1.0:1787841626.772470:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1787841626.772494:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787841626.772506:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc6725200/0xe3dac0c99affe125 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe12c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841626.772518:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff92cbc6725200/0xe3dac0c99affe125 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe12c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787841626.772530:0:5836:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787841626.772533:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92cbc3ed8000 from 1 10000000:01000000:1.0:1787841626.772537:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787841626.777524:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc169ac00/0xe3dac0c99affe148 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841626.777624:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff92cbc169ac00/0xe3dac0c99affe148 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841626.777643:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff92cbc169ac00/0xe3dac0c99affe148 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841626.777679:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4bb0780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714928512:0@lo:101: 00000100:00100000:1.0:1787841626.777827:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841626.777888:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbe76b4600 going to sleep for 11 seconds 00000100:00100000:1.0:1787841626.777935:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714928512 00000100:00100000:1.0:1787841626.777944:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714928512 00000100:00100000:1.0:1787841626.778008:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787841626.778020:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+14:5836:x1874687714928512:12345-0@lo:101: 00010000:00010000:1.0:1787841626.778039:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841626.778063:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92cbc169b600/0xe3dac0c99affe14f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe3dac0c99affe148 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841626.778097:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92cbc169b600/0xe3dac0c99affe14f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe3dac0c99affe148 expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841626.778110:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92cbc169b600/0xe3dac0c99affe14f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe3dac0c99affe148 expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841626.778121:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc169b600, rc 0) 00000100:00100000:1.0:1787841626.778163:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+15:5836:x1874687714928512:12345-0@lo:101: Request processed in 145us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841626.778170:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787841626.778243:0:3297:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787841626.778254:0:3297:0:(import.c:65:import_set_state_nolock()) ffff92cbff5b2800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787841626.778259:0:3297:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787841626.778266:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4bb03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1874687714928256:0@lo:8: 00000100:00100000:1.0:1787841626.778311:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4bb0780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714928512:0@lo:101: 00010000:00010000:1.0:1787841626.778327:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff92cbc169ac00/0xe3dac0c99affe148 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe14f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841626.778350:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff92cbc169ac00/0xe3dac0c99affe148 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe3dac0c99affe14f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841626.778730:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4bb0780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714928640:0@lo:501: 00000100:00100000:1.0:1787841626.778772:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841626.778818:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbe76b4600 going to sleep for 11 seconds 00000100:00100000:1.0:1787841626.778838:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714928640 00000100:00100000:1.0:1787841626.778842:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714928640 00000100:00100000:1.0:1787841626.778875:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787841626.778884:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+15:5836:x1874687714928640:12345-0@lo:501: 00000100:00100000:1.0:1787841626.779193:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+15:5836:x1874687714928640:12345-0@lo:501: Request processed in 310us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841626.779202:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787841626.779252:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4bb0780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714928640:0@lo:501: 00000100:00100000:1.0:1787841626.779287:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4bb0780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714928768:0@lo:503: 00000100:00100000:1.0:1787841626.782770:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841626.782848:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbe76b4600 going to sleep for 11 seconds 00000100:00100000:1.0:1787841626.782979:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714928768 00000100:00100000:1.0:1787841626.782991:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714928768 00000100:00100000:1.0:1787841626.783052:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787841626.783063:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+15:5836:x1874687714928768:12345-0@lo:503: 00000100:00100000:1.0:1787841626.783321:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+15:5836:x1874687714928768:12345-0@lo:503: Request processed in 259us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841626.783332:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787841626.783419:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4bb0780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714928768:0@lo:503: 00000100:00100000:1.0:1787841626.785950:0:6715:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4bb0780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f6e7591a-84a0-4774-9d28-b3ed28591dc5:6715:1874687714928896:0@lo:502: 00000100:00100000:1.0:1787841626.786061:0:6715:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841626.786116:0:6715:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbe76b46c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787841626.787150:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714928896 00000100:00100000:0.0:1787841626.787164:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714928896 00000100:00100000:0.0:1787841626.787234:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787841626.787246:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+15:6715:x1874687714928896:12345-0@lo:502: 00000100:00100000:0.0:1787841626.787549:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+15:6715:x1874687714928896:12345-0@lo:502: Request processed in 304us (1489us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841626.787557:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787841626.789071:0:6715:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4bb0780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f6e7591a-84a0-4774-9d28-b3ed28591dc5:6715:1874687714928896:0@lo:502: 00000020:01000000:1.0:1787841626.789135:0:6715:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787841626.789149:0:6715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787841626.789151:0:6715:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787841626.789159:0:6715:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff92cbc3ed8000 00000020:00000080:1.0:1787841626.789162:0:6715:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787841626.789223:0:6715:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4bb0780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f6e7591a-84a0-4774-9d28-b3ed28591dc5:6715:1874687714929024:0@lo:502: 00000100:00100000:1.0:1787841626.789316:0:6715:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841626.789363:0:6715:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbe76b46c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787841626.790370:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714929024 00000100:00100000:0.0:1787841626.790386:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714929024 00000100:00100000:0.0:1787841626.790453:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787841626.790464:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+15:6715:x1874687714929024:12345-0@lo:502: 00000100:00100000:0.0:1787841626.790846:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+15:6715:x1874687714929024:12345-0@lo:502: Request processed in 383us (1530us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841626.790856:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787841626.795150:0:6715:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4bb0780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f6e7591a-84a0-4774-9d28-b3ed28591dc5:6715:1874687714929024:0@lo:502: 00000020:01000000:2.0:1787841626.795229:0:6715:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787841626.795241:0:6715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787841626.795245:0:6715:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1787841626.795251:0:6715:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1787841626.798235:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1787841626.798285:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787841626.798300:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc169ac00/0xe3dac0c99affe148 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe14f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841626.798315:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff92cbc169ac00/0xe3dac0c99affe148 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe14f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787841626.798326:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1787841626.798329:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff92cbe9a69a48 from 1 10000000:01000000:1.0:1787841626.798333:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787841626.798386:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc169b000/0xe3dac0c99affe156 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841626.798395:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff92cbc169b000/0xe3dac0c99affe156 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841626.798428:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff92cbc169b000/0xe3dac0c99affe156 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841626.798461:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4bb03c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714929152:0@lo:101: 00000100:00100000:1.0:1787841626.798554:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841626.798761:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbe76b4900 going to sleep for 11 seconds 00000100:00100000:2.0:1787841626.807459:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714929152 00000100:00100000:2.0:1787841626.807482:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714929152 00000100:00100000:3.0:1787841626.808276:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787841626.808292:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+15:5836:x1874687714929152:12345-0@lo:101: 00010000:00010000:3.0:1787841626.808320:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841626.808351:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92cbc149de00/0xe3dac0c99affe15d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe3dac0c99affe156 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841626.808395:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92cbc149de00/0xe3dac0c99affe15d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe3dac0c99affe156 expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841626.808411:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92cbc149de00/0xe3dac0c99affe15d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe3dac0c99affe156 expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841626.808422:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc149de00, rc 0) 00000100:00100000:3.0:1787841626.808540:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+16:5836:x1874687714929152:12345-0@lo:101: Request processed in 252us (9986us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841626.808549:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787841626.808664:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4bb03c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714929152:0@lo:101: 00010000:00010000:1.0:1787841626.808689:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff92cbc169b000/0xe3dac0c99affe156 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe15d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841626.808768:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff92cbc169b000/0xe3dac0c99affe156 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xe3dac0c99affe15d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841626.808875:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4bb03c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714929280:0@lo:501: 00000100:00100000:1.0:1787841626.809062:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841626.809101:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbe76b4900 going to sleep for 11 seconds 00000100:00100000:1.0:1787841626.809132:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714929280 00000100:00100000:1.0:1787841626.809138:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714929280 00000100:00100000:1.0:1787841626.809216:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787841626.809225:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe9a1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+16:5836:x1874687714929280:12345-0@lo:501: 00000100:00100000:1.0:1787841626.809556:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe9a1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+16:5836:x1874687714929280:12345-0@lo:501: Request processed in 331us (494us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787841626.809565:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787841626.813203:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4bb03c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714929280:0@lo:501: 10000000:01000000:1.0:1787841626.813280:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787841626.813296:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc169b000/0xe3dac0c99affe156 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe15d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841626.813322:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff92cbc169b000/0xe3dac0c99affe156 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe15d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1787841626.945490:0:6684:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1787841626.945504:0:6684:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1787841626.945550:0:6684:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787841626.945628:0:6684:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.101@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787841626.945647:0:6684:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1787841626.945677:0:6684:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1787841627.713512:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841628.740276:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841629.761452:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841630.784835:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841631.809952:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787841632.001860:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787841632.001873:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787841632.001877:0:8:0:(import.c:65:import_set_state_nolock()) ffff92cbff5b2800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787841632.001896:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff92cbff5b2800 using connection 192.168.201.101@tcp/0@lo 00000100:00100000:0.0:1787841632.002025:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4a9d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1874687714929664:0@lo:400: 00000100:00100000:2.0:1787841632.002115:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92cbd4a9e1c0 x1874687714929792/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787841632.002190:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841632.002297:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714929664 00000100:00100000:0.0:1787841632.002306:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714929664 00000100:00100000:0.0:1787841632.002511:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787841632.002523:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbc3dccb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1874687714929664:12345-0@lo:400: 00000100:00100000:0.0:1787841632.002589:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbc3dccb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1874687714929664:12345-0@lo:400: Request processed in 68us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841632.002597:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787841632.002639:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92cbd4a9d680 x1874687714929664/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787841648 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787841632.002655:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4a9d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1874687714929664:0@lo:400: 00000100:00080000:1.0:1787841632.003319:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787841632.008152:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4a9fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3300:1874687714929408:0@lo:400: 00000100:00100000:2.0:1787841632.008273:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841632.008347:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787841632.008358:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4a9f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874687714929536:0@lo:400: 00000100:00100000:3.0:1787841632.008834:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714929408 00000100:00100000:3.0:1787841632.008847:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714929408 00000100:00100000:3.0:1787841632.008990:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787841632.009006:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe9a19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+16:3300:x1874687714929408:12345-0@lo:400: 00000100:00100000:3.0:1787841632.009099:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe9a19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+16:3300:x1874687714929408:12345-0@lo:400: Request processed in 96us (826us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841632.009108:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787841632.009565:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841632.009625:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4a9fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3300:1874687714929408:0@lo:400: 00000100:00100000:2.0:1787841632.009680:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4a9e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1874687714929792:0@lo:8: 00000100:00100000:3.0:1787841632.009820:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714929536 00000100:00100000:3.0:1787841632.009826:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714929536 00000100:00100000:3.0:1787841632.009866:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787841632.009875:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbd4a9d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874687714929536:12345-0@lo:400: 00000100:00100000:2.0:1787841632.010586:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841632.011027:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbd4a9d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874687714929536:12345-0@lo:400: Request processed in 1150us (1461us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841632.011037:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1787841632.011096:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92cbd4a9f0c0 x1874687714929536/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787841648 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787841632.011113:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4a9f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874687714929536:0@lo:400: 00000100:00100000:2.0:1787841632.011637:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714929792 00000100:00100000:2.0:1787841632.011647:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714929792 00000100:00100000:2.0:1787841632.012507:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787841632.012519:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbd4a9fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3297:x1874687714929792:12345-0@lo:8: 00010000:00080000:2.0:1787841632.012572:0:6688:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 172 last 0 00000020:00000080:2.0:1787841632.012614:0:6688:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe3dac0c99affe164 00002000:00100000:2.0:1787841632.012676:0:6688:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff92cbffa06000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211395f ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1787841632.012681:0:6688:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:2.0:1787841632.012686:0:6688:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1787841632.014487:0:6688:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787841632.015255:0:6688:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787841632.015307:0:6688:0:(import.c:65:import_set_state_nolock()) ffff92cbffa05800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787841632.016267:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbd4a9fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3297:x1874687714929792:12345-0@lo:8: Request processed in 3741us (5675us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841632.016282:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787841632.017146:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92cbd4a9e1c0 x1874687714929792/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787841642 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787841632.017171:0:3297:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1787841632.017184:0:3297:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787841632.017192:0:3297:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1787841632.017196:0:3297:0:(import.c:65:import_set_state_nolock()) ffff92cbff5b2800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787841632.017213:0:3297:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787841632.017221:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4a9e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1874687714929792:0@lo:8: 00000004:00080000:3.0:1787841632.017895:0:6713:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787841632.019005:0:6713:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 172017305166ns, next at 0ns, rc = 0 00000004:00080000:1.0:1787841632.178026:0:5860:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:1.0:1787841632.178128:0:6714:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:1.0:1787841632.178161:0:6714:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4bb30c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6714:1874687714930048:0@lo:7: 00000100:00100000:1.0:1787841632.178253:0:6714:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841632.178311:0:6714:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc5262540 going to sleep for 11 seconds 00000100:00100000:1.0:1787841632.178329:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4bb0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874687714929920:0@lo:13: 00000100:00100000:1.0:1787841632.178357:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841632.178402:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714930048 00000100:00100000:1.0:1787841632.178416:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714930048 00000100:00100000:1.0:1787841632.178490:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787841632.178502:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbd4bb0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6714:x1874687714930048:12345-0@lo:7: 00000100:00100000:0.0:1787841632.179824:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714929920 00000100:00100000:0.0:1787841632.179835:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714929920 00000100:00100000:0.0:1787841632.179881:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787841632.179892:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbd4bb03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3299:x1874687714929920:12345-0@lo:13: 00002000:00000024:0.0:1787841632.179925:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1787841632.180018:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbd4bb03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3299:x1874687714929920:12345-0@lo:13: Request processed in 127us (1658us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841632.180027:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787841632.180355:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92cbd4bb0f00 x1874687714929920/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841648 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787841632.180381:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4bb0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874687714929920:0@lo:13: 00000100:00080000:2.0:1787841632.180825:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:1.0:1787841632.188548:0:6687:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:1.0:1787841632.188560:0:6687:0:(ofd_dev.c:1211:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:1.0:1787841632.188801:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbd4bb0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6714:x1874687714930048:12345-0@lo:7: Request processed in 10295us (10541us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841632.188816:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787841632.194664:0:6714:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92cbd4bb30c0 x1874687714930048/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787841648 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787841632.194728:0:6714:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4bb30c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6714:1874687714930048:0@lo:7: 00000004:00080000:2.0:1787841632.194750:0:6714:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1787841632.194822:0:6714:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4a9e1c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6714:1874687714930176:0@lo:5: 00000100:00100000:2.0:1787841632.194979:0:6714:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841632.195044:0:6714:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbe76b4900 going to sleep for 11 seconds 00000100:00100000:1.0:1787841632.195278:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714930176 00000100:00100000:1.0:1787841632.195288:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714930176 00000100:00100000:1.0:1787841632.195361:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787841632.195373:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbd4a9f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6714:x1874687714930176:12345-0@lo:5: 00002000:00080000:1.0:1787841632.195412:0:6688:0:(ofd_dev.c:1643:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1787841632.195426:0:6688:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1787841632.195939:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbd4a9f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:6714:x1874687714930176:12345-0@lo:5: Request processed in 567us (1027us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1787841632.195947:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787841632.196001:0:6714:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92cbd4a9e1c0 x1874687714930176/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787841648 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787841632.196015:0:6714:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4a9e1c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6714:1874687714930176:0@lo:5: 00000004:00080000:1.0:1787841632.196027:0:6714:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1787841632.196059:0:6714:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4bb2d00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6714:1874687714930304:0@lo:700: 00000100:00100000:1.0:1787841632.196088:0:6714:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841632.196114:0:6714:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc5262840 going to sleep for 11 seconds 00000100:00100000:1.0:1787841632.196138:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714930304 00000100:00100000:1.0:1787841632.196142:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714930304 00000100:00100000:1.0:1787841632.196173:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787841632.196182:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbd4bb3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6714:x1874687714930304:12345-0@lo:700: 00000100:00100000:1.0:1787841632.196218:0:6695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4bb0780 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6695:1874687714930432:0@lo:700: 00000100:00100000:1.0:1787841632.196267:0:6695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841632.196284:0:6695:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc5262540 going to sleep for 11 seconds 00000100:00100000:1.0:1787841632.196310:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714930432 00000100:00100000:1.0:1787841632.196314:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714930432 00000100:00100000:1.0:1787841632.196340:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787841632.196347:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbd4bb30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6695:x1874687714930432:12345-0@lo:700: 40000000:02000000:1.0:1787841632.292914:0:5844:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:1.0:1787841632.301414:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbd4bb30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6695:x1874687714930432:12345-0@lo:700: Request processed in 105052us (105132us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841632.301434:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787841632.302127:0:6695:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92cbd4bb0780 x1874687714930432/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787841648 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787841632.302147:0:6695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4bb0780 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6695:1874687714930432:0@lo:700: 40000000:02000000:2.0:1787841632.302167:0:6695:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:0.0:1787841632.414139:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbd4bb3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6714:x1874687714930304:12345-0@lo:700: Request processed in 217941us (218032us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841632.414181:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000001:00080000:0.0:1787841632.414236:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:0.0:1787841632.414250:0:6717:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:0.0:1787841632.414299:0:6714:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92cbd4bb2d00 x1874687714930304/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787841648 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787841632.414328:0:6714:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4bb2d00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6714:1874687714930304:0@lo:700: 00000004:02000040:0.0:1787841632.463231:0:6714:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:0.0:1787841632.467067:0:6714:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbc3dcc3c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6714:1874687714930560:0@lo:5: 00000100:00100000:0.0:1787841632.467168:0:6714:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841632.467240:0:6714:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbf0515c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787841632.467379:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714930560 00000100:00100000:2.0:1787841632.467388:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714930560 00000100:00100000:2.0:1787841632.467464:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787841632.467477:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbc3dced00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:6714:x1874687714930560:12345-0@lo:5: 00002000:00080000:0.0:1787841632.477213:0:6687:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1787841632.477245:0:6687:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:0.0:1787841632.481312:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbc3dced00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6714:x1874687714930560:12345-0@lo:5: Request processed in 13826us (14132us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1787841632.481352:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1787841632.481755:0:6714:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92cbc3dcc3c0 x1874687714930560/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787841648 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787841632.481771:0:6714:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1787841632.481800:0:6714:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff92cbc3dcc3c0 x1874687714930560/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787841648 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787841632.481813:0:6714:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbc3dcc3c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6714:1874687714930560:0@lo:5: 00000004:00080000:2.0:1787841632.481832:0:6714:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:3.0:1787841632.832937:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787841633.421389:0:7058:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg101-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787841633.862050:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841634.881185:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841635.906385:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841636.932778:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787841637.120978:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbc3dcd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874687714931072:0@lo:400: 00000100:00100000:0.0:1787841637.121075:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841637.121141:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787841637.121146:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbc3dcc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1874687714930944:0@lo:400: 00000100:00100000:0.0:1787841637.121169:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841637.121199:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714931072 00000100:00100000:0.0:1787841637.121206:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714931072 00000100:00100000:0.0:1787841637.121285:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787841637.121296:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbc3dcd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3299:x1874687714931072:12345-0@lo:400: 00000100:00100000:0.0:1787841637.121356:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbc3dcd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3299:x1874687714931072:12345-0@lo:400: Request processed in 62us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841637.121363:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1787841637.121409:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787841637.121447:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92cbc3dcd680 x1874687714931072/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787841653 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787841637.121464:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbc3dcd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874687714931072:0@lo:400: 00000100:00100000:1.0:1787841637.121769:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbc3dce940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3300:1874687714930688:0@lo:400: 00000100:00100000:1.0:1787841637.121820:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841637.121846:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787841637.121859:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbc3dcfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874687714930816:0@lo:400: 00000100:00100000:1.0:1787841637.121883:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841637.121917:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714930944 00000100:00100000:1.0:1787841637.121921:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714930944 00000100:00100000:1.0:1787841637.121957:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714930816 00000100:00100000:1.0:1787841637.121959:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714930816 00000100:00100000:1.0:1787841637.121971:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787841637.121977:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbc3dce580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874687714930944:12345-0@lo:400: 00000100:00100000:1.0:1787841637.122013:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbc3dce580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874687714930944:12345-0@lo:400: Request processed in 36us (843us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841637.122019:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787841637.122032:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787841637.122037:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbd4bb0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874687714930816:12345-0@lo:400: 00000100:00100000:1.0:1787841637.122061:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbd4bb0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874687714930816:12345-0@lo:400: Request processed in 24us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841637.122066:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1787841637.122078:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787841637.122099:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92cbc3dcc780 x1874687714930944/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787841653 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787841637.122110:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbc3dcc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1874687714930944:0@lo:400: 00010000:00080000:1.0:1787841637.122128:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92cbc3dcfc00 x1874687714930816/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787841653 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787841637.122137:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbc3dcfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874687714930816:0@lo:400: 00000100:00100000:0.0:1787841637.123001:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714930688 00000100:00100000:0.0:1787841637.123011:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714930688 00000100:00100000:0.0:1787841637.123060:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787841637.123068:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe9a1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+16:3300:x1874687714930688:12345-0@lo:400: 00000100:00100000:0.0:1787841637.123129:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe9a1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+16:3300:x1874687714930688:12345-0@lo:400: Request processed in 63us (1309us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841637.123136:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787841637.123263:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbc3dce940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3300:1874687714930688:0@lo:400: 00000100:00100000:2.0:1787841637.633366:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787841637.633412:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4a9e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874687714931200:0@lo:13: 00000100:00100000:2.0:1787841637.633539:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841637.636745:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714931200 00000100:00100000:0.0:1787841637.636763:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714931200 00000100:00100000:0.0:1787841637.636826:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787841637.636838:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf07f9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1874687714931200:12345-0@lo:13: 00002000:00000024:0.0:1787841637.636886:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787841637.636992:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf07f9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1874687714931200:12345-0@lo:13: Request processed in 155us (3453us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841637.637001:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787841637.637238:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92cbd4a9e1c0 x1874687714931200/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841653 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787841637.637262:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4a9e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874687714931200:0@lo:13: 00000001:00080000:0.0:1787841637.725281:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:2.0:1787841637.952922:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841638.979027:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841640.001322:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841641.024906:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841642.050925:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787841642.248678:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbc3dce1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874687714931712:0@lo:400: 00000100:00100000:3.0:1787841642.248873:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbc3dcf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3301:1874687714931328:0@lo:400: 00000100:00100000:3.0:1787841642.248995:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841642.249084:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714931328 00000100:00100000:3.0:1787841642.249093:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714931328 00000100:00100000:3.0:1787841642.249157:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787841642.249169:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe9a1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+16:3301:x1874687714931328:12345-0@lo:400: 00000100:00100000:3.0:1787841642.249235:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe9a1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+16:3301:x1874687714931328:12345-0@lo:400: Request processed in 67us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841642.249244:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787841642.249304:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbc3dcf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3301:1874687714931328:0@lo:400: 00000100:00100000:0.0:1787841642.249596:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841642.249642:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbc3dcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874687714931456:0@lo:400: 00000100:00100000:0.0:1787841642.249672:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841642.249840:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787841642.249851:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbc3dcf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1874687714931584:0@lo:400: 00000100:00100000:0.0:1787841642.249880:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841642.250679:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714931456 00000100:00100000:3.0:1787841642.250689:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714931456 00000100:00100000:3.0:1787841642.250772:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714931584 00000100:00100000:3.0:1787841642.250776:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714931584 00000100:00100000:3.0:1787841642.250811:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787841642.250819:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbc3dcf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874687714931456:12345-0@lo:400: 00000100:00100000:3.0:1787841642.250894:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbc3dcf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874687714931456:12345-0@lo:400: Request processed in 75us (1220us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841642.250901:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787841642.250918:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787841642.250924:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbc3dcd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1874687714931584:12345-0@lo:400: 00000100:00100000:3.0:1787841642.250952:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbc3dcd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1874687714931584:12345-0@lo:400: Request processed in 29us (1072us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841642.250958:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1787841642.251000:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92cbc3dcf480 x1874687714931584/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787841658 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787841642.251014:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbc3dcf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1874687714931584:0@lo:400: 00010000:00080000:3.0:1787841642.251041:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92cbc3dcc000 x1874687714931456/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787841658 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787841642.251051:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbc3dcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874687714931456:0@lo:400: 00000100:00100000:1.0:1787841642.251232:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714931712 00000100:00100000:1.0:1787841642.251238:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714931712 00000100:00100000:1.0:1787841642.251288:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787841642.251298:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbc3dcda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1874687714931712:12345-0@lo:400: 00000100:00100000:1.0:1787841642.251357:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbc3dcda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1874687714931712:12345-0@lo:400: Request processed in 62us (1762us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841642.251364:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1787841642.251986:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787841642.251993:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787841642.252021:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92cbc3dce1c0 x1874687714931712/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787841658 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787841642.252031:0:3300:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1787841642.252045:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbc3dce1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874687714931712:0@lo:400: 00000100:00100000:2.0:1787841642.753341:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4bac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874687714931840:0@lo:13: 00000100:00100000:2.0:1787841642.753465:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841642.758165:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714931840 00000100:00100000:2.0:1787841642.758183:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714931840 00000100:00100000:2.0:1787841642.758252:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787841642.758261:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf07fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874687714931840:12345-0@lo:13: 00002000:00000024:2.0:1787841642.758309:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787841642.758429:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf07fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874687714931840:12345-0@lo:13: Request processed in 168us (4964us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841642.758435:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787841642.767385:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92cbd4bac000 x1874687714931840/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841658 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787841642.767420:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4bac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874687714931840:0@lo:13: 00010000:00010000:3.0:1787841643.075455:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841644.109235:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841645.127437:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841646.154964:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787841646.237860:0:7626:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787841646.237865:0:7626:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1787841646.238028:0:7626:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff92cbff856800 00000020:01000004:1.0:1787841646.238050:0:7626:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1787841646.238067:0:7626:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1787841646.238085:0:7626:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff92cbf4268000) 00000020:00000080:1.0:1787841646.238107:0:7626:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787841646.259099:0:7626:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1787841646.259894:0:7626:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1787841646.324100:0:7626:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1787841646.335684:0:7626:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787841646.336506:0:7626:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1787841646.337086:0:7626:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787841646.337134:0:7626:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1787841646.339196:0:7626:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1787841646.339230:0:7626:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787841646.339248:0:7626:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xe3dac0c99affe172 00000020:01000004:2.0:1787841646.339258:0:7626:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1787841646.339299:0:7626:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.101@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787841646.339304:0:7626:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.101@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787841646.339312:0:7626:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1787841646.339344:0:7626:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1787841646.339349:0:7626:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.101@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1787841646.370086:0:7626:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.101@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787841646.370220:0:7626:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.101@tcp, index=0001, flags=0x20062 00000020:01000004:1.0:1787841646.370230:0:7626:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787841646.370232:0:7626:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787841646.370233:0:7626:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787841646.370234:0:7626:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787841646.370235:0:7626:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787841646.370236:0:7626:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787841646.370238:0:7626:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787841646.370240:0:7626:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787841646.370241:0:7626:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787841646.370243:0:7626:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787841646.370245:0:7626:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787841646.370250:0:7626:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:1.0:1787841646.370369:0:7626:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787841646.370371:0:7626:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787841646.370372:0:7626:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787841646.370373:0:7626:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787841646.370374:0:7626:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787841646.370375:0:7626:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787841646.370376:0:7626:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787841646.370377:0:7626:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787841646.370378:0:7626:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787841646.370379:0:7626:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787841646.370380:0:7626:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787841646.370416:0:7626:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1787841646.370440:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4bb2d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:7626:1874687714931968:0@lo:253: 00000100:00100000:1.0:1787841646.370613:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841646.370690:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cc01e43240 going to sleep for 11 seconds 00000100:00100000:3.0:1787841646.370989:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714931968 00000100:00100000:3.0:1787841646.370999:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714931968 00000100:00100000:3.0:1787841646.371067:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787841646.371078:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe9a1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+16:7626:x1874687714931968:12345-0@lo:253: 20000000:01000000:3.0:1787841646.371399:0:5833:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1787841646.371404:0:5833:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:3.0:1787841646.371411:0:5833:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:3.0:1787841646.371415:0:5833:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:3.0:1787841646.373213:0:5833:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787841646.373671:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1787841646.373690:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:3.0:1787841646.373860:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1787841646.373869:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:3.0:1787841646.373895:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1787841646.373942:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1787841646.374625:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:3.0:1787841646.374652:0:5833:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.101@tcp 20000000:01000000:3.0:1787841646.374654:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.101@tcp (null) (null) (null) 00000040:00080000:3.0:1787841646.374691:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:3.0:1787841646.374935:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787841646.374994:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:3.0:1787841646.375004:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.201.101@tcp (null) (null) 00000040:00080000:3.0:1787841646.375038:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:3.0:1787841646.375048:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1787841646.375076:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:3.0:1787841646.375518:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:3.0:1787841646.377002:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:3.0:1787841646.377035:0:5833:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.101@tcp 20000000:01000000:3.0:1787841646.377038:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.101@tcp (null) (null) (null) 00000040:00080000:3.0:1787841646.377077:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:3.0:1787841646.377086:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1787841646.377193:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:3.0:1787841646.377203:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.201.101@tcp (null) (null) 00000040:00080000:3.0:1787841646.377237:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:3.0:1787841646.377247:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1787841646.377420:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:3.0:1787841646.377464:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:3.0:1787841646.377492:0:5833:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:3.0:1787841646.377496:0:5833:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:3.0:1787841646.377504:0:5833:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1787841646.377505:0:5833:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1787841646.377508:0:5833:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1787841646.377587:0:5833:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787841646.377592:0:5833:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1787841646.377638:0:5833:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1787841646.377641:0:5833:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787841646.379500:0:7628:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:1.0:1787841646.381231:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:1.0:1787841646.381429:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:1.0:1787841646.381592:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:1.0:1787841646.381617:0:5833:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787841646.381620:0:5833:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787841646.382880:0:7629:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1787841646.382961:0:7629:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1787841646.383019:0:7629:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1787841646.385620:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1787841646.386195:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1787841646.386440:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:1.0:1787841646.386463:0:5833:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787841646.386466:0:5833:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787841646.387956:0:7630:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:2.0:1787841646.388044:0:7630:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:2.0:1787841646.388105:0:7630:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1787841646.389457:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:1.0:1787841646.389590:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:1.0:1787841646.389635:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:1.0:1787841646.389651:0:5833:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1787841646.389654:0:5833:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787841646.391499:0:7631:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:2.0:1787841646.391677:0:7631:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:2.0:1787841646.391901:0:7631:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:0.0:1787841646.392423:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:0.0:1787841646.392470:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:0.0:1787841646.392616:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 10000000:01000000:0.0:1787841646.392643:0:5833:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787841646.392671:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff92cbc6725600/0xe3dac0c99affe179 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841646.392964:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92cbc13a3a00/0xe3dac0c99affe0bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe3dac0c99affe0b5 expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841646.392976:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92cbc149c400/0xe3dac0c99affe0e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe3dac0c99affe0df expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841646.392984:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92cbc6725c00/0xe3dac0c99affe110 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe3dac0c99affe109 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841646.392991:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92cbc149d600/0xe3dac0c99affe12c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe3dac0c99affe125 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841646.392999:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92cbc149de00/0xe3dac0c99affe15d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe3dac0c99affe156 expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841646.393008:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff92cbc6725600/0xe3dac0c99affe179 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841646.393063:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92cbc149de00/0xe3dac0c99affe15d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe3dac0c99affe156 expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841646.393081:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92cbc149de00/0xe3dac0c99affe15d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe3dac0c99affe156 expref: 16 pid: 5833 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841646.393130:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbc3dccf00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5833:1874687714932096:0@lo:104: 00000100:00100000:0.0:1787841646.393235:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787841646.393308:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92cbc149d600/0xe3dac0c99affe12c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe3dac0c99affe125 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841646.393318:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92cbc149d600/0xe3dac0c99affe12c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe3dac0c99affe125 expref: 16 pid: 5832 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841646.393327:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbc3dce940 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5833:1874687714932224:0@lo:104: 00010000:00010000:0.0:1787841646.393353:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92cbc6725c00/0xe3dac0c99affe110 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe3dac0c99affe109 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841646.393361:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92cbc6725c00/0xe3dac0c99affe110 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe3dac0c99affe109 expref: 16 pid: 5832 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841646.393369:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbc3dcfc00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5833:1874687714932352:0@lo:104: 00010000:00010000:0.0:1787841646.393393:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92cbc149c400/0xe3dac0c99affe0e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe3dac0c99affe0df expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841646.393400:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92cbc149c400/0xe3dac0c99affe0e6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe3dac0c99affe0df expref: 16 pid: 5832 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841646.393407:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbc3dcc780 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5833:1874687714932480:0@lo:104: 00010000:00010000:0.0:1787841646.393431:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92cbc13a3a00/0xe3dac0c99affe0bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe3dac0c99affe0b5 expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841646.393438:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92cbc13a3a00/0xe3dac0c99affe0bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe3dac0c99affe0b5 expref: 16 pid: 5833 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841646.393457:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbc3dce1c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5833:1874687714932608:0@lo:104: 00000100:00100000:0.0:1787841646.393479:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc5262d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787841646.394398:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787841646.394430:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841646.394498:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841646.394515:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841646.394616:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714932096 00000100:00100000:3.0:1787841646.394626:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714932096 00000100:00100000:3.0:1787841646.394674:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714932224 00000100:00100000:3.0:1787841646.394678:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714932224 00000100:00100000:3.0:1787841646.394689:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714932352 00000100:00100000:3.0:1787841646.394691:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714932352 00000100:00100000:3.0:1787841646.394738:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714932480 00000100:00100000:3.0:1787841646.394741:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714932480 00000100:00100000:3.0:1787841646.394757:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787841646.394767:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe9990050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+6:5833:x1874687714932096:12345-0@lo:104: 00010000:00010000:3.0:1787841646.394798:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.101@tcp lock: ffff92cbc169b000/0xe3dac0c99affe156 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xe3dac0c99affe15d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841646.394868:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787841646.394874:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe9990050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+6:5833:x1874687714932096:12345-0@lo:104: Request processed in 109us (1640us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841646.394882:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787841646.394933:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787841646.394939:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbd4bb0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+5:5833:x1874687714932224:12345-0@lo:104: 00010000:00010000:3.0:1787841646.394946:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.101@tcp lock: ffff92cbc6725200/0xe3dac0c99affe125 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xe3dac0c99affe12c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841646.394980:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787841646.394985:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbd4bb0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+5:5833:x1874687714932224:12345-0@lo:104: Request processed in 47us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841646.394990:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787841646.395001:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787841646.395006:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf8dc8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+4:5833:x1874687714932352:12345-0@lo:104: 00010000:00010000:3.0:1787841646.395013:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.101@tcp lock: ffff92cbc13a3c00/0xe3dac0c99affe109 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xe3dac0c99affe110 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841646.395035:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787841646.395040:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf8dc8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+4:5833:x1874687714932352:12345-0@lo:104: Request processed in 34us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841646.395045:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787841646.395054:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787841646.395060:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf8dcb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+3:5833:x1874687714932480:12345-0@lo:104: 00010000:00010000:3.0:1787841646.395074:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.101@tcp lock: ffff92cbc13a2c00/0xe3dac0c99affe0df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xe3dac0c99affe0e6 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841646.395098:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1787841646.395103:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf8dcb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+3:5833:x1874687714932480:12345-0@lo:104: Request processed in 44us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841646.395109:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:3.0:1787841646.395155:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787841646.395162:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.101@tcp lock: ffff92cbc169b000/0xe3dac0c99affe156 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xe3dac0c99affe15d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841646.395171:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc169b000 already unused, calling callback (ffffffffc1d9fc20) 10000000:00010000:3.0:1787841646.395176:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.101@tcp lock: ffff92cbc169b000/0xe3dac0c99affe156 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xe3dac0c99affe15d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841646.395184:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.101@tcp lock: ffff92cbc169b000/0xe3dac0c99affe156 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xe3dac0c99affe15d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787841646.395192:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.101@tcp lock: ffff92cbc169b000/0xe3dac0c99affe156 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xe3dac0c99affe15d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787841646.395197:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787841646.395233:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.101@tcp lock: ffff92cbc169b000/0xe3dac0c99affe156 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99affe15d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841646.395239:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787841646.395259:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.101@tcp lock: ffff92cbc169b000/0xe3dac0c99affe156 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99affe15d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841646.395275:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.101@tcp lock: ffff92cbc169b000/0xe3dac0c99affe156 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99affe15d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841646.395452:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787841646.395455:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.101@tcp lock: ffff92cbc6725200/0xe3dac0c99affe125 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe3dac0c99affe12c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841646.395461:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6725200 already unused, calling callback (ffffffffc1d9fc20) 10000000:00010000:3.0:1787841646.395463:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.101@tcp lock: ffff92cbc6725200/0xe3dac0c99affe125 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xe3dac0c99affe12c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841646.395471:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.101@tcp lock: ffff92cbc6725200/0xe3dac0c99affe125 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xe3dac0c99affe12c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787841646.395478:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.101@tcp lock: ffff92cbc6725200/0xe3dac0c99affe125 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xe3dac0c99affe12c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787841646.395492:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787841646.395508:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.101@tcp lock: ffff92cbc6725200/0xe3dac0c99affe125 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99affe12c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841646.395513:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787841646.395519:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.101@tcp lock: ffff92cbc6725200/0xe3dac0c99affe125 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99affe12c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841646.395625:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.101@tcp lock: ffff92cbc6725200/0xe3dac0c99affe125 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99affe12c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841646.395635:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787841646.395639:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.101@tcp lock: ffff92cbc13a3c00/0xe3dac0c99affe109 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe3dac0c99affe110 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841646.395656:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc13a3c00 already unused, calling callback (ffffffffc1d9fc20) 10000000:00010000:3.0:1787841646.395659:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.101@tcp lock: ffff92cbc13a3c00/0xe3dac0c99affe109 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xe3dac0c99affe110 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841646.395665:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.101@tcp lock: ffff92cbc13a3c00/0xe3dac0c99affe109 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xe3dac0c99affe110 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787841646.395672:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.101@tcp lock: ffff92cbc13a3c00/0xe3dac0c99affe109 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xe3dac0c99affe110 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787841646.395677:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787841646.395693:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.101@tcp lock: ffff92cbc13a3c00/0xe3dac0c99affe109 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99affe110 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841646.395789:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787841646.395809:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.101@tcp lock: ffff92cbc13a3c00/0xe3dac0c99affe109 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99affe110 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841646.395815:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.101@tcp lock: ffff92cbc13a3c00/0xe3dac0c99affe109 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99affe110 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841646.395827:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787841646.395830:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.101@tcp lock: ffff92cbc13a2c00/0xe3dac0c99affe0df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe3dac0c99affe0e6 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841646.395837:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc13a2c00 already unused, calling callback (ffffffffc1d9fc20) 10000000:00010000:3.0:1787841646.395840:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.101@tcp lock: ffff92cbc13a2c00/0xe3dac0c99affe0df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe3dac0c99affe0e6 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841646.395861:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.101@tcp lock: ffff92cbc13a2c00/0xe3dac0c99affe0df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe3dac0c99affe0e6 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787841646.395867:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.101@tcp lock: ffff92cbc13a2c00/0xe3dac0c99affe0df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe3dac0c99affe0e6 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787841646.395872:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787841646.395886:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.101@tcp lock: ffff92cbc13a2c00/0xe3dac0c99affe0df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99affe0e6 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841646.395892:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787841646.395897:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.101@tcp lock: ffff92cbc13a2c00/0xe3dac0c99affe0df lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99affe0e6 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841646.395903:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.101@tcp lock: ffff92cbc13a2c00/0xe3dac0c99affe0df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99affe0e6 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841646.395916:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841646.395918:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841646.395920:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787841646.395938:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4bac780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3298:1874687714932736:0@lo:103: 00000100:00100000:3.0:1787841646.395981:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841646.396029:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787841646.396035:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4bacf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3298:1874687714932864:0@lo:103: 00000100:00100000:3.0:1787841646.396056:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841646.396123:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714932736 00000100:00100000:3.0:1787841646.396128:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714932736 00010000:00010000:3.0:1787841646.396152:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92cbc149de00/0xe3dac0c99affe15d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe3dac0c99affe156 expref: 17 pid: 5833 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841646.396186:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714932864 00000100:00100000:3.0:1787841646.396189:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714932864 00010000:00010000:3.0:1787841646.396202:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92cbc149d600/0xe3dac0c99affe12c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe3dac0c99affe125 expref: 18 pid: 5832 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841646.396215:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787841646.396222:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbd4bae1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+18:3298:x1874687714932736:12345-0@lo:103: 00010000:00010000:3.0:1787841646.396235:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787841646.396241:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92cbc149de00/0xe3dac0c99affe15d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe3dac0c99affe156 expref: 18 pid: 5833 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841646.396258:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92cbc149de00/0xe3dac0c99affe15d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe3dac0c99affe156 expref: 18 pid: 5833 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841646.396377:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841646.396404:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714932608 00000100:00100000:1.0:1787841646.396408:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714932608 00000100:00100000:1.0:1787841646.396432:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787841646.396439:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf8dcb840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+3:5833:x1874687714932608:12345-0@lo:104: 00010000:00010000:1.0:1787841646.396448:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.101@tcp lock: ffff92cbc13a3e00/0xe3dac0c99affe0b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe3dac0c99affe0bc expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841646.396500:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787841646.396505:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf8dcb840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+3:5833:x1874687714932608:12345-0@lo:104: Request processed in 67us (1979us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841646.396514:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787841646.396613:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4baf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3301:1874687714933120:0@lo:103: 00000100:00100000:1.0:1787841646.396641:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841646.396655:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787841646.396660:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4bac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3301:1874687714932992:0@lo:103: 00000100:00100000:1.0:1787841646.396680:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841646.396727:0:5825:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1787841646.396736:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:1.0:1787841646.396749:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787841646.396753:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.101@tcp lock: ffff92cbc13a3e00/0xe3dac0c99affe0b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe3dac0c99affe0bc expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841646.396766:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc13a3e00 already unused, calling callback (ffffffffc1d9fc20) 10000000:00010000:1.0:1787841646.396769:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.101@tcp lock: ffff92cbc13a3e00/0xe3dac0c99affe0b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe3dac0c99affe0bc expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841646.396777:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.101@tcp lock: ffff92cbc13a3e00/0xe3dac0c99affe0b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe3dac0c99affe0bc expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787841646.396782:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.101@tcp lock: ffff92cbc13a3e00/0xe3dac0c99affe0b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe3dac0c99affe0bc expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787841646.396788:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787841646.396811:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.101@tcp lock: ffff92cbc13a3e00/0xe3dac0c99affe0b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99affe0bc expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841646.396818:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787841646.396827:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.101@tcp lock: ffff92cbc13a3e00/0xe3dac0c99affe0b5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99affe0bc expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841646.396834:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.101@tcp lock: ffff92cbc13a3e00/0xe3dac0c99affe0b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99affe0bc expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841646.396851:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841646.396853:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841646.396854:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787841646.396867:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf8dcb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3298:1874687714933248:0@lo:103: 00000100:00100000:1.0:1787841646.396891:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787841646.397087:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841646.397298:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92cbc149de00/0xe3dac0c99affe15d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe3dac0c99affe156 expref: 18 pid: 5833 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841646.397313:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbc3dccf00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5833:1874687714932096:0@lo:104: 00000100:00100000:0.0:1787841646.397327:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbc3dce940 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5833:1874687714932224:0@lo:104: 00000100:00100000:0.0:1787841646.397336:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbc3dcfc00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5833:1874687714932352:0@lo:104: 00000100:00100000:0.0:1787841646.397343:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbc3dcc780 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5833:1874687714932480:0@lo:104: 00000100:00100000:0.0:1787841646.397349:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbc3dce1c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5833:1874687714932608:0@lo:104: 00010000:00010000:3.0:1787841646.397465:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787841646.397514:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbd4bae1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+17:3298:x1874687714932736:12345-0@lo:103: Request processed in 1292us (1532us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841646.397523:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787841646.397909:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714933120 00000100:00100000:3.0:1787841646.397915:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714933120 00010000:00010000:3.0:1787841646.397937:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92cbc149c400/0xe3dac0c99affe0e6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe3dac0c99affe0df expref: 17 pid: 5832 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841646.397952:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714932992 00000100:00100000:3.0:1787841646.397955:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714932992 00010000:00010000:3.0:1787841646.397965:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92cbc6725c00/0xe3dac0c99affe110 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe3dac0c99affe109 expref: 18 pid: 5832 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841646.397973:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714933248 00000100:00100000:3.0:1787841646.397984:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714933248 00010000:00010000:3.0:1787841646.397997:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92cbc13a3a00/0xe3dac0c99affe0bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe3dac0c99affe0b5 expref: 19 pid: 5833 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841646.398010:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787841646.398018:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbd4baed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:3298:x1874687714932864:12345-0@lo:103: 00010000:00010000:3.0:1787841646.398029:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787841646.398034:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92cbc149d600/0xe3dac0c99affe12c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe3dac0c99affe125 expref: 19 pid: 5832 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841646.398120:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787841646.398130:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf8dc9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:3301:x1874687714933120:12345-0@lo:103: 00010000:00010000:1.0:1787841646.398151:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787841646.398156:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92cbc149c400/0xe3dac0c99affe0e6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe3dac0c99affe0df expref: 19 pid: 5832 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841646.398611:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff92cbc6725600/0xe3dac0c99affe179 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841646.398673:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92cbc149d600/0xe3dac0c99affe12c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe3dac0c99affe125 expref: 19 pid: 5832 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841646.398694:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92cbc149d600/0xe3dac0c99affe12c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe3dac0c99affe125 expref: 19 pid: 5832 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841646.398841:0:7632:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:0.0:1787841646.398849:0:7632:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00010000:00010000:3.0:1787841646.399081:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787841646.399150:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbd4baed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+18:3298:x1874687714932864:12345-0@lo:103: Request processed in 1132us (3092us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841646.399159:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787841646.399179:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787841646.399189:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf8dc8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+17:3301:x1874687714932992:12345-0@lo:103: 00010000:00010000:3.0:1787841646.399200:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787841646.399206:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92cbc6725c00/0xe3dac0c99affe110 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe3dac0c99affe109 expref: 17 pid: 5832 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841646.399216:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92cbc6725c00/0xe3dac0c99affe110 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe3dac0c99affe109 expref: 17 pid: 5832 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841646.399227:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92cbc6725c00/0xe3dac0c99affe110 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe3dac0c99affe109 expref: 17 pid: 5832 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841646.399246:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787841646.399274:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf8dc8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+16:3301:x1874687714932992:12345-0@lo:103: Request processed in 88us (2593us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841646.399426:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4bac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3301:1874687714932992:0@lo:103: 00000100:00100000:3.0:1787841646.399474:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787841646.399500:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787841646.399507:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf8dca940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+15:3298:x1874687714933248:12345-0@lo:103: 00010000:00010000:3.0:1787841646.399516:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787841646.399521:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92cbc13a3a00/0xe3dac0c99affe0bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe3dac0c99affe0b5 expref: 15 pid: 5833 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841646.399539:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92cbc13a3a00/0xe3dac0c99affe0bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe3dac0c99affe0b5 expref: 15 pid: 5833 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841646.399549:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92cbc13a3a00/0xe3dac0c99affe0bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe3dac0c99affe0b5 expref: 15 pid: 5833 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841646.399559:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787841646.399584:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf8dca940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+14:3298:x1874687714933248:12345-0@lo:103: Request processed in 78us (2692us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841646.399591:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787841646.399617:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf8dcb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3298:1874687714933248:0@lo:103: 00000100:00100000:3.0:1787841646.399628:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4bacf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3298:1874687714932864:0@lo:103: 00000100:00100000:3.0:1787841646.399637:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4bac780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3298:1874687714932736:0@lo:103: 00010000:00010000:1.0:1787841646.400098:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92cbc149c400/0xe3dac0c99affe0e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe3dac0c99affe0df expref: 13 pid: 5832 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841646.400122:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92cbc149c400/0xe3dac0c99affe0e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe3dac0c99affe0df expref: 13 pid: 5832 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841646.400135:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff92cbc6725600/0xe3dac0c99affe179 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841646.400145:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92cbc6725600/0xe3dac0c99affe179 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841646.400163:0:5825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92cbc6725600/0xe3dac0c99affe179 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841646.400171:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92cbc6725600/0xe3dac0c99affe179 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841646.400179:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff92cbc6725600/0xe3dac0c99affe179 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841646.400186:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff92cbc6725600/0xe3dac0c99affe179 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841646.400193:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6725600 already unused, calling callback (ffffffffc17a4500) 00010000:00010000:1.0:1787841646.400197:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff92cbc6725600/0xe3dac0c99affe179 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841646.400220:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff92cbc6725600/0xe3dac0c99affe179 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841646.400244:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff92cbc6725600/0xe3dac0c99affe179 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841646.400255:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787841646.400400:0:5833:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff92cbc6725600/0xe3dac0c99affe179 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841646.400420:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff92cbc6725600/0xe3dac0c99affe179 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841646.400427:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92cbc6725600/0xe3dac0c99affe179 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787841646.400446:0:5833:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1787841646.402508:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf8dc9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+12:3301:x1874687714933120:12345-0@lo:103: Request processed in 4366us (5852us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841646.402534:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787841646.402608:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4baf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3301:1874687714933120:0@lo:103: 00000100:00100000:1.0:1787841646.465427:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe9a1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+11:7626:x1874687714931968:12345-0@lo:253: Request processed in 94335us (94798us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841646.465447:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787841646.465802:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4bb2d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:7626:1874687714931968:0@lo:253: 10000000:01000000:3.0:1787841646.465824:0:7626:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1787841646.465829:0:7626:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787841646.465831:0:7626:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787841646.465832:0:7626:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787841646.465834:0:7626:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:3.0:1787841646.465835:0:7626:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787841646.465837:0:7626:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787841646.465839:0:7626:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787841646.465841:0:7626:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1787841646.465843:0:7626:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787841646.465844:0:7626:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787841646.465881:0:7626:0:(tgt_mount.c:101:server_register_mount()) register mount ffff92cbff856800 from lustre-OST0001 10000000:01000000:3.0:1787841646.465919:0:7626:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1787841646.465922:0:7626:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1787841646.465933:0:7626:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff92cbe9a69a48 local copy 10000000:01000000:3.0:1787841646.465938:0:7626:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787841646.465990:0:7626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc149d600/0xe3dac0c99affe180 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841646.466003:0:7626:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.101@tcp lock: ffff92cbc149d600/0xe3dac0c99affe180 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841646.466015:0:7626:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff92cbc149d600/0xe3dac0c99affe180 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841646.466060:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4bac780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:7626:1874687714933376:0@lo:101: 00000100:00100000:3.0:1787841646.466187:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841646.466424:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc8ff3240 going to sleep for 11 seconds 00000100:00100000:0.0:1787841646.466622:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714933376 00000100:00100000:0.0:1787841646.466630:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714933376 00000100:00100000:0.0:1787841646.466842:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787841646.466854:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe9a1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+11:7626:x1874687714933376:12345-0@lo:101: 00010000:00010000:0.0:1787841646.466871:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841646.466891:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92cbc6724000/0xe3dac0c99affe187 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe3dac0c99affe180 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841646.466924:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92cbc6724000/0xe3dac0c99affe187 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe3dac0c99affe180 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841646.466952:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92cbc6724000/0xe3dac0c99affe187 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe3dac0c99affe180 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841646.466964:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc6724000, rc 0) 00000100:00100000:0.0:1787841646.467028:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe9a1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+12:7626:x1874687714933376:12345-0@lo:101: Request processed in 176us (841us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841646.467036:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787841646.467126:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4bac780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:7626:1874687714933376:0@lo:101: 00010000:00010000:1.0:1787841646.467147:0:7626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff92cbc149d600/0xe3dac0c99affe180 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xe3dac0c99affe187 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841646.467158:0:7626:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff92cbc149d600/0xe3dac0c99affe180 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xe3dac0c99affe187 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841646.467343:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf8dc8b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:7626:1874687714933504:0@lo:501: 00000100:00100000:1.0:1787841646.467377:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841646.467734:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cc01e43240 going to sleep for 11 seconds 00000100:00100000:3.0:1787841646.467894:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714933504 00000100:00100000:3.0:1787841646.467900:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714933504 00000100:00100000:3.0:1787841646.467928:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787841646.467935:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe9a1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+12:7626:x1874687714933504:12345-0@lo:501: 00000100:00100000:3.0:1787841646.468195:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe9a1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+12:7626:x1874687714933504:12345-0@lo:501: Request processed in 259us (816us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787841646.468203:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787841646.468452:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf8dc8b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:7626:1874687714933504:0@lo:501: 10000000:01000000:1.0:1787841646.468469:0:7626:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.101@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787841646.468514:0:7626:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.101@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787841646.468531:0:7626:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc149d600/0xe3dac0c99affe180 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xe3dac0c99affe187 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841646.468543:0:7626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc149d600/0xe3dac0c99affe180 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xe3dac0c99affe187 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841646.468551:0:7626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.101@tcp lock: ffff92cbc149d600/0xe3dac0c99affe180 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xe3dac0c99affe187 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841646.468575:0:7626:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787841646.468600:0:7626:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff92cbff856800 10000000:01000000:1.0:1787841646.468606:0:7626:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787841646.468613:0:7626:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787841646.468616:0:7626:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787841646.468622:0:7626:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1787841646.468626:0:7626:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1787841646.468654:0:7626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc169a200/0xe3dac0c99affe18e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841646.468663:0:7626:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff92cbc169a200/0xe3dac0c99affe18e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841646.468672:0:7626:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff92cbc169a200/0xe3dac0c99affe18e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841646.468687:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf8dc8b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:7626:1874687714933632:0@lo:101: 00000100:00100000:1.0:1787841646.468758:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841646.468785:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714933632 00000100:00100000:1.0:1787841646.468789:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714933632 00000100:00100000:1.0:1787841646.468817:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787841646.468824:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe9a19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+12:7626:x1874687714933632:12345-0@lo:101: 00010000:00010000:1.0:1787841646.468834:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841646.468846:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92cbc169b400/0xe3dac0c99affe195 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe3dac0c99affe18e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841646.468868:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92cbc169b400/0xe3dac0c99affe195 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe3dac0c99affe18e expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841646.468880:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92cbc169b400/0xe3dac0c99affe195 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe3dac0c99affe18e expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841646.468889:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc169b400, rc 0) 00000100:00100000:1.0:1787841646.468912:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe9a19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+13:7626:x1874687714933632:12345-0@lo:101: Request processed in 89us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841646.468918:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787841646.468953:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cc01e43000 going to sleep for 11 seconds 00000100:00100000:1.0:1787841646.468966:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf8dc8b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:7626:1874687714933632:0@lo:101: 00010000:00010000:1.0:1787841646.468977:0:7626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff92cbc169a200/0xe3dac0c99affe18e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe195 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841646.468985:0:7626:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff92cbc169a200/0xe3dac0c99affe18e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe3dac0c99affe195 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841646.469042:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf8dc8b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:7626:1874687714933760:0@lo:501: 00000100:00100000:1.0:1787841646.469067:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841646.469088:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714933760 00000100:00100000:1.0:1787841646.469091:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714933760 00000100:00100000:1.0:1787841646.469119:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787841646.469132:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe9a1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+13:7626:x1874687714933760:12345-0@lo:501: 00000100:00100000:1.0:1787841646.469644:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe9a1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+13:7626:x1874687714933760:12345-0@lo:501: Request processed in 511us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841646.469652:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787841646.469681:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cc01e43000 going to sleep for 11 seconds 00000100:00100000:1.0:1787841646.469695:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf8dc8b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:7626:1874687714933760:0@lo:501: 00000100:00100000:1.0:1787841646.469819:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf8dc8b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:7626:1874687714933888:0@lo:503: 00000100:00100000:1.0:1787841646.469864:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841646.469884:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714933888 00000100:00100000:1.0:1787841646.469888:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714933888 00000100:00100000:1.0:1787841646.469906:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787841646.469912:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe9a19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+13:7626:x1874687714933888:12345-0@lo:503: 00000100:00100000:1.0:1787841646.470066:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe9a19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+13:7626:x1874687714933888:12345-0@lo:503: Request processed in 153us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841646.470073:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787841646.470121:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cc01e43000 going to sleep for 11 seconds 00000100:00100000:1.0:1787841646.470134:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf8dc8b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:7626:1874687714933888:0@lo:503: 00010000:00010000:3.0:1787841646.470410:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787841646.470419:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.101@tcp lock: ffff92cbc149d600/0xe3dac0c99affe180 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xe3dac0c99affe187 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841646.470430:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc149d600 already unused, calling callback (ffffffffc1d9fc20) 10000000:00010000:3.0:1787841646.470434:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.101@tcp lock: ffff92cbc149d600/0xe3dac0c99affe180 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xe3dac0c99affe187 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841646.470445:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.101@tcp lock: ffff92cbc149d600/0xe3dac0c99affe180 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xe3dac0c99affe187 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787841646.470453:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.101@tcp lock: ffff92cbc149d600/0xe3dac0c99affe180 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xe3dac0c99affe187 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787841646.470460:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787841646.470499:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.101@tcp lock: ffff92cbc149d600/0xe3dac0c99affe180 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xe3dac0c99affe187 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841646.470517:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787841646.470617:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.101@tcp lock: ffff92cbc149d600/0xe3dac0c99affe180 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xe3dac0c99affe187 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841646.470625:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.101@tcp lock: ffff92cbc149d600/0xe3dac0c99affe180 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xe3dac0c99affe187 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841646.470641:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841646.470643:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841646.470644:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787841646.470653:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787841646.470666:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4bacf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3298:1874687714934016:0@lo:103: 00000100:00100000:3.0:1787841646.470811:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841646.472444:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714934016 00000100:00100000:3.0:1787841646.472458:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714934016 00000100:00100000:3.0:1787841646.472605:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787841646.472616:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbd4bad680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+13:3298:x1874687714934016:12345-0@lo:103: 00010000:00010000:3.0:1787841646.472635:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787841646.472658:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92cbc6724000/0xe3dac0c99affe187 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe3dac0c99affe180 expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841646.472677:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000040:00080000:1.0:1787841646.473205:0:7626:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787841646.473418:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbd4bad680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+12:3298:x1874687714934016:12345-0@lo:103: Request processed in 802us (2605us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841646.473429:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787841646.473497:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4bacf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3298:1874687714934016:0@lo:103: 00000100:00100000:1.0:1787841646.473844:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf8dc8b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:7626:1874687714934144:0@lo:502: 00000100:00100000:1.0:1787841646.473918:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841646.473952:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cc01e43000 going to sleep for 11 seconds 00000100:00100000:2.0:1787841646.474049:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714934144 00000100:00100000:2.0:1787841646.474056:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714934144 00000100:00100000:2.0:1787841646.474098:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787841646.474174:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe9a18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+12:7626:x1874687714934144:12345-0@lo:502: 00000100:00100000:2.0:1787841646.474987:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe9a18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+12:7626:x1874687714934144:12345-0@lo:502: Request processed in 879us (1067us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841646.474996:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787841646.475391:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf8dc8b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:7626:1874687714934144:0@lo:502: 00000040:00080000:1.0:1787841646.476415:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1787841646.476505:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1787841646.476616:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1787841646.476667:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1787841646.476877:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1787841646.476914:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1787841646.476968:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf8dc8b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:7626:1874687714934272:0@lo:502: 00000100:00100000:1.0:1787841646.477049:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841646.477105:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cc01e43000 going to sleep for 11 seconds 00000100:00100000:2.0:1787841646.477236:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714934272 00000100:00100000:2.0:1787841646.477244:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714934272 00000100:00100000:2.0:1787841646.477498:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787841646.477509:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe9a1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+12:7626:x1874687714934272:12345-0@lo:502: 00000100:00100000:2.0:1787841646.477780:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe9a1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+12:7626:x1874687714934272:12345-0@lo:502: Request processed in 273us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841646.477795:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787841646.477888:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf8dc8b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:7626:1874687714934272:0@lo:502: 00000040:00080000:1.0:1787841646.477991:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1787841646.478001:0:7626:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1787841646.478941:0:7634:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787841646.478952:0:7634:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1787841646.478961:0:7634:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787841646.478963:0:7634:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1787841646.478968:0:7634:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787841646.479000:0:7634:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff92cbf8e23490) 00000020:00000080:1.0:1787841646.479030:0:7634:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787841646.479037:0:7634:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787841646.479123:0:7634:0:(tgt_mount.c:153:server_get_mount()) get mount ffff92cbff856800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1787841646.479131:0:7634:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787841646.479139:0:7634:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xe3dac0c99affe1a3 00010000:00010000:1.0:1787841646.484884:0:7634:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:1.0:1787841646.487516:0:7634:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1787841646.495851:0:7634:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1787841646.496242:0:7634:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1787841646.502063:0:7634:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1787841646.502952:0:7634:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1787841646.505928:0:7634:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1787841646.505955:0:7634:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787841646.505965:0:7634:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787841646.505967:0:7634:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1787841646.505972:0:7634:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787841646.505977:0:7634:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787841646.505978:0:7634:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787841646.505981:0:7634:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787841646.505983:0:7634:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787841646.506060:0:7634:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787841646.506065:0:7634:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787841646.506066:0:7634:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787841646.506070:0:7634:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1787841646.508468:0:7626:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1787841646.508587:0:7626:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1787841646.508664:0:7626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc169a200/0xe3dac0c99affe18e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe195 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841646.508692:0:7626:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff92cbc169a200/0xe3dac0c99affe18e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe195 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787841646.509740:0:7626:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92cbff856800 from 1 10000000:01000000:3.0:1787841646.509749:0:7626:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787841646.509821:0:7626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc149d600/0xe3dac0c99affe1aa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841646.509832:0:7626:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff92cbc149d600/0xe3dac0c99affe1aa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841646.509846:0:7626:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff92cbc149d600/0xe3dac0c99affe1aa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841646.509877:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4bacf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:7626:1874687714934400:0@lo:101: 00000100:00100000:3.0:1787841646.509975:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841646.510100:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc8ff39c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787841646.511668:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714934400 00000100:00100000:0.0:1787841646.511681:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714934400 00000100:00100000:0.0:1787841646.511823:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787841646.511835:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe9a1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+12:7626:x1874687714934400:12345-0@lo:101: 00010000:00010000:0.0:1787841646.511855:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841646.511878:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92cbc6724000/0xe3dac0c99affe1b1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe3dac0c99affe1aa expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841646.511915:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92cbc6724000/0xe3dac0c99affe1b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe3dac0c99affe1aa expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841646.511929:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92cbc6724000/0xe3dac0c99affe1b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe3dac0c99affe1aa expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841646.511942:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc6724000, rc 0) 00000100:00100000:0.0:1787841646.512021:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe9a1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+13:7626:x1874687714934400:12345-0@lo:101: Request processed in 188us (2046us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841646.512029:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787841646.512100:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4bacf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:7626:1874687714934400:0@lo:101: 00010000:00010000:0.0:1787841646.512122:0:7626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff92cbc149d600/0xe3dac0c99affe1aa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe1b1 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841646.512142:0:7626:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff92cbc149d600/0xe3dac0c99affe1aa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe3dac0c99affe1b1 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841646.518170:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbc3dce1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:7626:1874687714934528:0@lo:501: 00000100:00100000:1.0:1787841646.518384:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841646.518444:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbf0784c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787841646.518515:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714934528 00000100:00100000:3.0:1787841646.518534:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714934528 00000100:00100000:3.0:1787841646.518595:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787841646.518607:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe9a18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+13:7626:x1874687714934528:12345-0@lo:501: 00000100:00100000:3.0:1787841646.519059:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe9a18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+13:7626:x1874687714934528:12345-0@lo:501: Request processed in 453us (779us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841646.519074:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787841646.519171:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbc3dce1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:7626:1874687714934528:0@lo:501: 00000100:00100000:1.0:1787841646.519217:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf8dc8b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:7626:1874687714934656:0@lo:503: 00000100:00100000:1.0:1787841646.519270:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841646.519415:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbf0784c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787841646.519513:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714934656 00000100:00100000:0.0:1787841646.519519:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714934656 00000100:00100000:0.0:1787841646.519564:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787841646.519573:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe9a18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+13:7626:x1874687714934656:12345-0@lo:503: 00000100:00100000:0.0:1787841646.519923:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe9a18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+13:7626:x1874687714934656:12345-0@lo:503: Request processed in 351us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841646.519930:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787841646.519971:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf8dc8b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:7626:1874687714934656:0@lo:503: 00000040:00080000:0.0:1787841646.520663:0:7626:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787841646.520930:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbc3dcc780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:7626:1874687714934784:0@lo:502: 00000100:00100000:0.0:1787841646.520991:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841646.521064:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbd1fe7900 going to sleep for 11 seconds 00000100:00100000:1.0:1787841646.522211:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714934784 00000100:00100000:1.0:1787841646.522224:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714934784 00000100:00100000:3.0:1787841646.522515:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787841646.522533:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe9a19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+13:7626:x1874687714934784:12345-0@lo:502: 00000100:00100000:3.0:1787841646.523050:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe9a19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+13:7626:x1874687714934784:12345-0@lo:502: Request processed in 517us (2057us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841646.523059:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787841646.523168:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbc3dcc780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:7626:1874687714934784:0@lo:502: 00000040:00080000:2.0:1787841646.523547:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1787841646.523609:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1787841646.523648:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf07fb0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:7626:1874687714934912:0@lo:502: 00000100:00100000:2.0:1787841646.523694:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841646.524199:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbf046fe40 going to sleep for 11 seconds 00000100:00100000:1.0:1787841646.524379:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714934912 00000100:00100000:1.0:1787841646.524388:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714934912 00000100:00100000:1.0:1787841646.524430:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787841646.524438:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe9a18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+13:7626:x1874687714934912:12345-0@lo:502: 00000100:00100000:1.0:1787841646.524661:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe9a18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+13:7626:x1874687714934912:12345-0@lo:502: Request processed in 223us (966us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841646.524669:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787841646.524884:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf07fb0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:7626:1874687714934912:0@lo:502: 00000040:00080000:2.0:1787841646.524999:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1787841646.525011:0:7626:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1787841646.525945:0:7638:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787841646.525959:0:7638:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787841646.525962:0:7638:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787841646.525969:0:7638:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff92cbff856800 00000020:00000080:2.0:1787841646.525971:0:7638:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787841646.525988:0:7638:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787841646.525990:0:7638:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787841646.525992:0:7638:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1787841646.525995:0:7638:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1787841646.526122:0:7626:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1787841646.526153:0:7626:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787841646.526179:0:7626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc149d600/0xe3dac0c99affe1aa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe1b1 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841646.526192:0:7626:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff92cbc149d600/0xe3dac0c99affe1aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe1b1 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787841646.526365:0:7626:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787841646.526369:0:7626:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff92cbff856800 10000000:01000000:1.0:1787841646.526373:0:7626:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff92cbff856800 10000000:01000000:1.0:1787841646.526378:0:7626:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787841646.526386:0:7626:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff92cbff856800 from 1 10000000:01000000:1.0:1787841646.526389:0:7626:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787841646.526433:0:7626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc169ba00/0xe3dac0c99affe1b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841646.526442:0:7626:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff92cbc169ba00/0xe3dac0c99affe1b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841646.526454:0:7626:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff92cbc169ba00/0xe3dac0c99affe1b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841646.526486:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf8dca580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:7626:1874687714935040:0@lo:101: 00000100:00100000:1.0:1787841646.526618:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841646.526661:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714935040 00000100:00100000:1.0:1787841646.526668:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714935040 00000100:00100000:1.0:1787841646.526801:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787841646.526812:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+13:7626:x1874687714935040:12345-0@lo:101: 00010000:00010000:1.0:1787841646.526828:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841646.526846:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92cbc169b800/0xe3dac0c99affe1bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe3dac0c99affe1b8 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841646.526873:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92cbc169b800/0xe3dac0c99affe1bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe3dac0c99affe1b8 expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841646.526885:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92cbc169b800/0xe3dac0c99affe1bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe3dac0c99affe1b8 expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841646.526903:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc169b800, rc 0) 00000100:00100000:1.0:1787841646.526936:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+14:7626:x1874687714935040:12345-0@lo:101: Request processed in 127us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841646.526943:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787841646.526987:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbf0784900 going to sleep for 11 seconds 00000100:00100000:1.0:1787841646.527006:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf8dca580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:7626:1874687714935040:0@lo:101: 00010000:00010000:1.0:1787841646.527020:0:7626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff92cbc169ba00/0xe3dac0c99affe1b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe1bf expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841646.527029:0:7626:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff92cbc169ba00/0xe3dac0c99affe1b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe3dac0c99affe1bf expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841646.527131:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf8dca580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:7626:1874687714935168:0@lo:501: 00000100:00100000:1.0:1787841646.527162:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841646.527181:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714935168 00000100:00100000:1.0:1787841646.527184:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714935168 00000100:00100000:1.0:1787841646.527199:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787841646.527204:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+14:7626:x1874687714935168:12345-0@lo:501: 00000100:00100000:2.0:1787841646.527806:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbf0784900 going to sleep for 11 seconds 00000100:00100000:1.0:1787841646.528001:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+14:7626:x1874687714935168:12345-0@lo:501: Request processed in 794us (836us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841646.528011:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787841646.528411:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf8dca580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:7626:1874687714935168:0@lo:501: 00000100:00100000:3.0:1787841646.528592:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4bada40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:7626:1874687714935296:0@lo:503: 00000100:00100000:3.0:1787841646.528649:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841646.528907:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc8ff3c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787841646.532620:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714935296 00000100:00100000:0.0:1787841646.532643:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714935296 00000100:00100000:1.0:1787841646.533686:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787841646.533726:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+14:7626:x1874687714935296:12345-0@lo:503: 00000100:00100000:1.0:1787841646.534021:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+14:7626:x1874687714935296:12345-0@lo:503: Request processed in 325us (5371us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841646.534034:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787841646.534273:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4bada40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:7626:1874687714935296:0@lo:503: 00000040:00080000:0.0:1787841646.534846:0:7626:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787841646.534945:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbc3dcfc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:7626:1874687714935424:0@lo:502: 00000100:00100000:0.0:1787841646.534999:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841646.535037:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbd1fe7900 going to sleep for 11 seconds 00000100:00100000:2.0:1787841646.535087:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714935424 00000100:00100000:2.0:1787841646.535092:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714935424 00000100:00100000:2.0:1787841646.535125:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787841646.535133:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+14:7626:x1874687714935424:12345-0@lo:502: 00000100:00100000:2.0:1787841646.535363:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+14:7626:x1874687714935424:12345-0@lo:502: Request processed in 231us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841646.535375:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787841646.535578:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbc3dcfc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:7626:1874687714935424:0@lo:502: 00000040:00080000:0.0:1787841646.536047:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1787841646.536090:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1787841646.536128:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1787841646.536176:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1787841646.536202:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1787841646.536241:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1787841646.537511:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1787841646.537833:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1787841646.537881:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1787841646.537901:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1787841646.537918:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1787841646.537943:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1787841646.537961:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1787841646.537978:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1787841646.538001:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1787841646.538020:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1787841646.538036:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1787841646.538061:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1787841646.538079:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1787841646.538096:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1787841646.538150:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1787841646.538184:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1787841646.538218:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1787841646.538268:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1787841646.539601:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1787841646.539658:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1787841646.539995:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1787841646.540025:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:0.0:1787841646.540042:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1787841646.540068:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:0.0:1787841646.540086:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:0.0:1787841646.540103:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:0.0:1787841646.540130:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:0.0:1787841646.540176:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:0.0:1787841646.540198:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:0.0:1787841646.540246:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:0.0:1787841646.540459:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:0.0:1787841646.540596:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbc3dcfc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:7626:1874687714935552:0@lo:502: 00000100:00100000:0.0:1787841646.541076:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841646.541148:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbd1fe7900 going to sleep for 11 seconds 00000100:00100000:2.0:1787841646.541195:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714935552 00000100:00100000:2.0:1787841646.541204:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714935552 00000100:00100000:2.0:1787841646.541384:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787841646.541394:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+14:7626:x1874687714935552:12345-0@lo:502: 00000100:00100000:2.0:1787841646.541885:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+14:7626:x1874687714935552:12345-0@lo:502: Request processed in 491us (808us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841646.541892:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787841646.541963:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbc3dcfc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:7626:1874687714935552:0@lo:502: 00000040:00080000:0.0:1787841646.542055:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:0.0:1787841646.542066:0:7626:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:2.0:1787841646.542871:0:7639:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1787841646.542894:0:7639:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff92cac218b490) 00000020:00000080:2.0:1787841646.542918:0:7639:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:2.0:1787841646.542991:0:7639:0:(tgt_mount.c:153:server_get_mount()) get mount ffff92cbff856800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787841646.542995:0:7639:0:(tgt_mount.c:187:server_put_mount()) put mount ffff92cbff856800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787841646.542997:0:7639:0:(obd_mount.c:710:lustre_put_lsi()) put ffff92cbff856800 3 00010000:00080000:2.0:1787841646.543028:0:7639:0:(ldlm_lib.c:102:import_set_conn()) imp ffff92cbf71ae800@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.101@tcp at head 00010000:00010000:3.0:1787841646.545035:0:7639:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:3.0:1787841646.545430:0:7639:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1787841646.545489:0:7639:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787841646.545504:0:7639:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xe3dac0c99affe1cd 00000100:00080000:3.0:1787841646.545516:0:7639:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787841646.545582:0:7639:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff92cbf71ae800 using connection 192.168.201.101@tcp/0@lo 00000100:00100000:3.0:1787841646.545643:0:7639:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92cbd4bae940 x1874687714935680/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787841646.545674:0:7639:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787841646.545976:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf8dcad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1874687714935936:0@lo:400: 00000100:00100000:1.0:1787841646.546050:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841646.546087:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787841646.546091:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf8dc83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874687714935808:0@lo:400: 00000100:00100000:1.0:1787841646.546106:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841646.546131:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf8dc92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687714936064:0@lo:400: 00000100:00100000:1.0:1787841646.546158:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841646.546189:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714935936 00000100:00100000:1.0:1787841646.546195:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714935936 00000100:00100000:1.0:1787841646.546236:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714935808 00000100:00100000:1.0:1787841646.546237:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714935808 00000100:00100000:1.0:1787841646.546250:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787841646.546346:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf8dcbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874687714935936:12345-0@lo:400: 00000100:00100000:1.0:1787841646.546394:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf8dcbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874687714935936:12345-0@lo:400: Request processed in 137us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841646.546399:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787841646.546415:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787841646.546419:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf8dc8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874687714935808:12345-0@lo:400: 00000100:00100000:1.0:1787841646.546434:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf8dc8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874687714935808:12345-0@lo:400: Request processed in 15us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841646.546439:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787841646.546460:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714936064 00000100:00100000:1.0:1787841646.546463:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714936064 00000100:00100000:1.0:1787841646.546503:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787841646.546510:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf8dc9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3298:x1874687714936064:12345-0@lo:400: 00000100:00100000:2.0:1787841646.546625:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4bae940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3297:1874687714935680:0@lo:38: 00000100:00100000:2.0:1787841646.546661:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841646.546783:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714935680 00000100:00100000:2.0:1787841646.546787:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714935680 00000100:00100000:2.0:1787841646.546802:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787841646.546806:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf07fb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3297:x1874687714935680:12345-0@lo:38: 00010000:00080000:2.0:1787841646.546828:0:5837:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 186 last 0 00000020:00000080:2.0:1787841646.546855:0:5837:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xe3dac0c99affe1d4 00000004:00100000:2.0:1787841646.546874:0:5837:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787841646.546906:0:5837:0:(import.c:65:import_set_state_nolock()) ffff92cbf71ae000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787841646.546936:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf07fb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1874687714935680:12345-0@lo:38: Request processed in 129us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841646.546948:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1787841646.546965:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787841646.546968:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787841646.546989:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92cbd4bae940 x1874687714935680/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787841656 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787841646.546999:0:3297:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787841646.547007:0:3297:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1787841646.547013:0:3297:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787841646.547016:0:3297:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787841646.547018:0:3297:0:(import.c:65:import_set_state_nolock()) ffff92cbf71ae800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787841646.547022:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4bae940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3297:1874687714935680:0@lo:38: 00010000:00080000:2.0:1787841646.547116:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92cbf8dc83c0 x1874687714935808/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787841662 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787841646.547126:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf8dc83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874687714935808:0@lo:400: 00010000:00080000:2.0:1787841646.547136:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92cbf8dcad00 x1874687714935936/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787841662 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787841646.547144:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf8dcad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1874687714935936:0@lo:400: 00000100:00100000:1.0:1787841646.547243:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf8dc9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3298:x1874687714936064:12345-0@lo:400: Request processed in 734us (1083us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841646.547248:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000040:00080000:3.0:1787841646.547545:0:7639:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00010000:00080000:2.0:1787841646.547857:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92cbf8dc92c0 x1874687714936064/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787841662 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787841646.547865:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf8dc92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687714936064:0@lo:400: 00000100:00100000:2.0:1787841646.547922:0:7640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf07fa940 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7640:1874687714936192:0@lo:901: 00000100:00100000:2.0:1787841646.547948:0:7640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841646.547969:0:7640:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbf046fd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787841646.548059:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714936192 00000100:00100000:3.0:1787841646.548063:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714936192 00000100:00100000:3.0:1787841646.548098:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787841646.548103:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf07f8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7640:x1874687714936192:12345-0@lo:901: 00000020:01000000:1.0:1787841646.548377:0:7626:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1787841646.548411:0:7626:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787841646.548426:0:7626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc169ba00/0xe3dac0c99affe1b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe1bf expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841646.548435:0:7626:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff92cbc169ba00/0xe3dac0c99affe1b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe1bf expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787841646.548497:0:7626:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787841646.548500:0:7626:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787841646.548501:0:7626:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787841646.548502:0:7626:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787841646.548503:0:7626:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787841646.548504:0:7626:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787841646.548506:0:7626:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787841646.548508:0:7626:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787841646.548510:0:7626:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787841646.548512:0:7626:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787841646.548513:0:7626:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787841646.548518:0:7626:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000100:00080000:2.0:1787841646.548802:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:01000004:1.0:1787841646.548868:0:7626:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787841646.548869:0:7626:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787841646.548871:0:7626:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787841646.548872:0:7626:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787841646.548873:0:7626:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787841646.548874:0:7626:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787841646.548874:0:7626:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787841646.548875:0:7626:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787841646.548876:0:7626:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787841646.548877:0:7626:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787841646.548878:0:7626:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787841646.548894:0:7626:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1787841646.548902:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf8dc9a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:7626:1874687714936320:0@lo:253: 00000100:00100000:1.0:1787841646.548949:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841646.549467:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf07f8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7640:x1874687714936192:12345-0@lo:901: Request processed in 1360us (1514us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841646.549488:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787841646.549639:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbf0784240 going to sleep for 11 seconds 00000100:00100000:2.0:1787841646.550880:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714936320 00000100:00100000:2.0:1787841646.550890:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714936320 00000100:00100000:2.0:1787841646.550940:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787841646.550949:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+14:7626:x1874687714936320:12345-0@lo:253: 20000000:01000000:2.0:1787841646.550981:0:5831:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1787841646.550998:0:5831:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:2.0:1787841646.551645:0:7640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92cbf07fa940 x1874687714936192/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1787841662 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787841646.551660:0:7640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf07fa940 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7640:1874687714936192:0@lo:901: 20000000:01000000:2.0:1787841646.590114:0:5831:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787841646.590135:0:5831:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1787841646.591220:0:5853:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787841646.591230:0:5853:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787841646.591269:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff92cbc169be00/0xe3dac0c99affe1db lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841646.591361:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92cbc13a3000/0xe3dac0c99affe11e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe3dac0c99affe117 expref: 14 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841646.591372:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff92cbc169be00/0xe3dac0c99affe1db lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841646.591426:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92cbc13a3000/0xe3dac0c99affe11e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe3dac0c99affe117 expref: 14 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841646.591442:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92cbc13a3000/0xe3dac0c99affe11e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe3dac0c99affe117 expref: 14 pid: 5831 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841646.591460:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf8dca1c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5853:1874687714936448:0@lo:104: 00000100:00100000:1.0:1787841646.591623:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841646.591682:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc4c30300 going to sleep for 11 seconds 00000100:00100000:2.0:1787841646.591832:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714936448 00000100:00100000:2.0:1787841646.591843:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714936448 00000100:00100000:2.0:1787841646.591901:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787841646.591914:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf8dc92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+3:5853:x1874687714936448:12345-0@lo:104: 00010000:00010000:2.0:1787841646.591929:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.101@tcp lock: ffff92cbc149c200/0xe3dac0c99affe117 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe3dac0c99affe11e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841646.593991:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787841646.594009:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf8dc92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+3:5853:x1874687714936448:12345-0@lo:104: Request processed in 2093us (2382us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841646.594023:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1787841646.594123:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787841646.594135:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.101@tcp lock: ffff92cbc149c200/0xe3dac0c99affe117 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe3dac0c99affe11e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841646.594146:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc149c200 already unused, calling callback (ffffffffc1d9fc20) 10000000:00010000:3.0:1787841646.594151:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.101@tcp lock: ffff92cbc149c200/0xe3dac0c99affe117 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe3dac0c99affe11e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841646.594162:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.101@tcp lock: ffff92cbc149c200/0xe3dac0c99affe117 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe3dac0c99affe11e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787841646.594169:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.101@tcp lock: ffff92cbc149c200/0xe3dac0c99affe117 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe3dac0c99affe11e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787841646.594175:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787841646.594234:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.101@tcp lock: ffff92cbc149c200/0xe3dac0c99affe117 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99affe11e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841646.594240:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787841646.594276:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.101@tcp lock: ffff92cbc149c200/0xe3dac0c99affe117 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99affe11e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841646.594291:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.101@tcp lock: ffff92cbc149c200/0xe3dac0c99affe117 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99affe11e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841646.594309:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841646.594311:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841646.594313:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787841646.594331:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4bad2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3299:1874687714936576:0@lo:103: 00000100:00100000:3.0:1787841646.594406:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841646.594474:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714936576 00000100:00100000:3.0:1787841646.594509:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714936576 00010000:00010000:3.0:1787841646.594556:0:7632:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92cbc13a3000/0xe3dac0c99affe11e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe3dac0c99affe117 expref: 15 pid: 5831 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841646.594587:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787841646.594595:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcdb7f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f6e7591a-84a0-4774-9d28-b3ed28591dc5+15:3299:x1874687714936576:12345-0@lo:103: 00010000:00010000:3.0:1787841646.594611:0:7632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787841646.594616:0:7632:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92cbc13a3000/0xe3dac0c99affe11e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe3dac0c99affe117 expref: 15 pid: 5831 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841646.594629:0:7632:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92cbc13a3000/0xe3dac0c99affe11e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe3dac0c99affe117 expref: 15 pid: 5831 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841646.594653:0:7632:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff92cbc169be00/0xe3dac0c99affe1db lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841646.594663:0:7632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92cbc169be00/0xe3dac0c99affe1db lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787841646.594682:0:7632:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003453716s 00010000:00010000:3.0:1787841646.594688:0:7632:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92cbc169be00/0xe3dac0c99affe1db lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841646.594965:0:7632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92cbc169be00/0xe3dac0c99affe1db lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841646.594976:0:7632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff92cbc169be00/0xe3dac0c99affe1db lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841646.594984:0:7632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff92cbc169be00/0xe3dac0c99affe1db lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841646.595000:0:7632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc169be00 already unused, calling callback (ffffffffc17a4500) 00010000:00010000:3.0:1787841646.595005:0:7632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff92cbc169be00/0xe3dac0c99affe1db lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841646.595014:0:7632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff92cbc169be00/0xe3dac0c99affe1db lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841646.595024:0:7632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff92cbc169be00/0xe3dac0c99affe1db lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841646.595036:0:7632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787841646.595081:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcdb7f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f6e7591a-84a0-4774-9d28-b3ed28591dc5+15:3299:x1874687714936576:12345-0@lo:103: Request processed in 486us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841646.595090:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787841646.595189:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4bad2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3299:1874687714936576:0@lo:103: 00010000:00010000:1.0:1787841646.595663:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92cbc13a3000/0xe3dac0c99affe11e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe3dac0c99affe117 expref: 14 pid: 5831 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841646.595678:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf8dca1c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5853:1874687714936448:0@lo:104: 00010000:00010000:1.0:1787841646.595726:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff92cbc169be00/0xe3dac0c99affe1db lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841646.595737:0:5853:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff92cbc169be00/0xe3dac0c99affe1db lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841646.595753:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff92cbc169be00/0xe3dac0c99affe1db lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841646.595760:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92cbc169be00/0xe3dac0c99affe1db lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841646.631673:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+13:7626:x1874687714936320:12345-0@lo:253: Request processed in 80708us (82706us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841646.631693:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787841646.631901:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf8dc9a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f6e7591a-84a0-4774-9d28-b3ed28591dc5:7626:1874687714936320:0@lo:253: 10000000:01000000:1.0:1787841646.631923:0:7626:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1787841646.631927:0:7626:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787841646.631929:0:7626:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787841646.631931:0:7626:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787841646.631932:0:7626:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787841646.631933:0:7626:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787841646.631935:0:7626:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787841646.631937:0:7626:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787841646.631939:0:7626:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787841646.631940:0:7626:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787841646.631943:0:7626:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787841646.631944:0:7626:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787841646.631964:0:7626:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787841646.644437:0:7626:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1787841646.644987:0:7626:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787841646.645452:0:7626:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1787841646.645937:0:7626:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787841646.646213:0:7626:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1787841646.646880:0:7626:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1787841646.648094:0:7626:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:2.0:1787841647.170026:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1787841647.179677:0:7626:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1787841647.179687:0:7626:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1787841647.179748:0:7626:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787841647.179823:0:7626:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.101@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787841647.179842:0:7626:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1787841647.179879:0:7626:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00000100:00100000:2.0:1787841647.874993:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787841647.875030:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4bad2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874687714936704:0@lo:13: 00000100:00100000:2.0:1787841647.875124:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841647.875265:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714936704 00000100:00100000:3.0:1787841647.875274:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714936704 00000100:00100000:3.0:1787841647.875348:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787841647.875359:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf07fa940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874687714936704:12345-0@lo:13: 00002000:00000024:3.0:1787841647.875406:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787841647.875485:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf07fa940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874687714936704:12345-0@lo:13: Request processed in 128us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841647.875493:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787841647.875574:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbd4bad2c0 x1874687714936704/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841663 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787841647.875608:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4bad2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874687714936704:0@lo:13: 00010000:00010000:2.0:1787841648.197823:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841649.227455:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841650.247715:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841651.265987:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787841651.972789:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbc3dccf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874687714937216:0@lo:400: 00000100:00100000:0.0:1787841651.972887:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841651.972944:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787841651.972951:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbc3dcc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3300:1874687714936832:0@lo:400: 00000100:00100000:0.0:1787841651.972981:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841651.973005:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbc3dcfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1874687714937344:0@lo:400: 00000100:00100000:0.0:1787841651.973049:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841651.973077:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbc3dcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874687714936960:0@lo:400: 00000100:00100000:0.0:1787841651.973307:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841651.973326:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787841651.973331:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbc3dcf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1874687714937088:0@lo:400: 00000100:00100000:0.0:1787841651.973370:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841651.973415:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714937216 00000100:00100000:0.0:1787841651.973421:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714937216 00000100:00100000:0.0:1787841651.973478:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787841651.973488:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbc3dce940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1874687714937216:12345-0@lo:400: 00000100:00100000:0.0:1787841651.973544:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbc3dce940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1874687714937216:12345-0@lo:400: Request processed in 58us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841651.973552:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787841651.973688:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbc3dccf00 x1874687714937216/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787841667 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787841651.973729:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbc3dccf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874687714937216:0@lo:400: 00000100:00100000:1.0:1787841651.974091:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714937344 00000100:00100000:1.0:1787841651.974097:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714937344 00000100:00100000:1.0:1787841651.974126:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714936960 00000100:00100000:1.0:1787841651.974129:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714936960 00000100:00100000:1.0:1787841651.974142:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714937088 00000100:00100000:1.0:1787841651.974145:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714937088 00000100:00100000:1.0:1787841651.974159:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787841651.974175:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbc3dcc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874687714937344:12345-0@lo:400: 00000100:00100000:1.0:1787841651.974225:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbc3dcc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874687714937344:12345-0@lo:400: Request processed in 53us (1175us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841651.974232:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787841651.974249:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787841651.974254:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbc3dce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874687714936960:12345-0@lo:400: 00000100:00100000:1.0:1787841651.974299:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbc3dce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874687714936960:12345-0@lo:400: Request processed in 33us (979us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841651.974305:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787841651.974317:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787841651.974324:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf8e81e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1874687714937088:12345-0@lo:400: 00000100:00100000:1.0:1787841651.974350:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf8e81e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1874687714937088:12345-0@lo:400: Request processed in 27us (980us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841651.974357:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1787841651.974493:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbc3dcf480 x1874687714937088/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787841667 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787841651.974505:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbc3dcf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1874687714937088:0@lo:400: 00010000:00080000:1.0:1787841651.974517:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbc3dcc000 x1874687714936960/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787841667 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787841651.974525:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbc3dcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874687714936960:0@lo:400: 00010000:00080000:1.0:1787841651.974561:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbc3dcfc00 x1874687714937344/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787841667 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787841651.974569:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbc3dcfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1874687714937344:0@lo:400: 00000100:00100000:0.0:1787841651.975070:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714936832 00000100:00100000:0.0:1787841651.978959:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714936832 00000100:00100000:0.0:1787841651.979038:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787841651.979048:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+13:3300:x1874687714936832:12345-0@lo:400: 00000100:00100000:0.0:1787841651.980632:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+13:3300:x1874687714936832:12345-0@lo:400: Request processed in 1579us (7643us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841651.980645:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:0.0:1787841651.980723:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787841651.980729:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787841651.983431:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbc3dcc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3300:1874687714936832:0@lo:400: 00010000:00010000:0.0:1787841652.291835:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787841652.994741:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf07fa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687714937472:0@lo:13: 00000100:00100000:2.0:1787841652.994821:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841652.994902:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714937472 00000100:00100000:2.0:1787841652.994910:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714937472 00000100:00100000:2.0:1787841652.994970:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787841652.994980:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf07f83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874687714937472:12345-0@lo:13: 00002000:00000024:2.0:1787841652.995020:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787841652.995065:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf07f83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874687714937472:12345-0@lo:13: Request processed in 86us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841652.995071:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1787841652.995110:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbf07fa580 x1874687714937472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841668 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787841652.995129:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf07fa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687714937472:0@lo:13: 00010000:00010000:3.0:1787841653.313001:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841654.341512:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841655.362453:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841656.387758:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787841656.435260:0:7983:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg101-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 10000000:01000000:0.0:1787841656.581361:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787841656.581368:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff92cbf04e3800 from 30 10000000:01000000:0.0:1787841656.581374:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787841656.581416:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc6724a00/0xe3dac0c99affe1e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841656.581428:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff92cbc6724a00/0xe3dac0c99affe1e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841656.581440:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff92cbc6724a00/0xe3dac0c99affe1e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841656.581464:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf8e830c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714937600:0@lo:101: 00000100:00100000:0.0:1787841656.581535:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841656.581578:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cac33249c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787841656.582609:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714937600 00000100:00100000:3.0:1787841656.582619:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714937600 00000100:00100000:3.0:1787841656.582683:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787841656.582693:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+13:5836:x1874687714937600:12345-0@lo:101: 00010000:00010000:3.0:1787841656.582738:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841656.582757:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92cbc149c200/0xe3dac0c99affe1e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe3dac0c99affe1e2 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841656.582785:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92cbc149c200/0xe3dac0c99affe1e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe3dac0c99affe1e2 expref: 14 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841656.582796:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92cbc149c200/0xe3dac0c99affe1e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe3dac0c99affe1e2 expref: 14 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841656.582805:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc149c200, rc 0) 00000100:00100000:3.0:1787841656.583225:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+14:5836:x1874687714937600:12345-0@lo:101: Request processed in 533us (1688us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841656.583233:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787841656.583352:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf8e830c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714937600:0@lo:101: 00010000:00010000:1.0:1787841656.583372:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff92cbc6724a00/0xe3dac0c99affe1e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe1e9 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841656.583382:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff92cbc6724a00/0xe3dac0c99affe1e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe3dac0c99affe1e9 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841656.583447:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf8dcad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714937728:0@lo:501: 00000100:00100000:1.0:1787841656.583494:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841656.583522:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbf7238780 going to sleep for 11 seconds 00000100:00100000:0.0:1787841656.586692:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714937728 00000100:00100000:0.0:1787841656.586726:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714937728 00000100:00100000:0.0:1787841656.586787:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787841656.586797:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+14:5836:x1874687714937728:12345-0@lo:501: 00000100:00100000:0.0:1787841656.587249:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+14:5836:x1874687714937728:12345-0@lo:501: Request processed in 452us (3754us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841656.587257:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787841656.587931:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf8dcad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714937728:0@lo:501: 00000100:00100000:1.0:1787841656.587983:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf8dcad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714937856:0@lo:503: 00000100:00100000:2.0:1787841656.588054:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841656.588093:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbf7238780 going to sleep for 11 seconds 00000100:00100000:1.0:1787841656.588177:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714937856 00000100:00100000:1.0:1787841656.588183:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714937856 00000100:00100000:1.0:1787841656.588221:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787841656.588229:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+14:5836:x1874687714937856:12345-0@lo:503: 00000100:00100000:1.0:1787841656.588584:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+14:5836:x1874687714937856:12345-0@lo:503: Request processed in 355us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841656.588591:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787841656.594862:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf8dcad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714937856:0@lo:503: 00000100:00100000:0.0:1787841656.601162:0:7989:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf8e82940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f6e7591a-84a0-4774-9d28-b3ed28591dc5:7989:1874687714937984:0@lo:502: 00000100:00100000:0.0:1787841656.601264:0:7989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841656.601308:0:7989:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cac3324780 going to sleep for 11 seconds 00000100:00100000:1.0:1787841656.603613:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714937984 00000100:00100000:1.0:1787841656.603629:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714937984 00000100:00100000:1.0:1787841656.603680:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787841656.603689:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+14:7989:x1874687714937984:12345-0@lo:502: 00000100:00100000:1.0:1787841656.604108:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+14:7989:x1874687714937984:12345-0@lo:502: Request processed in 418us (2842us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841656.604125:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787841656.604304:0:7989:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf8e82940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f6e7591a-84a0-4774-9d28-b3ed28591dc5:7989:1874687714937984:0@lo:502: 00000100:00100000:0.0:1787841656.604382:0:7989:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf8e82940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f6e7591a-84a0-4774-9d28-b3ed28591dc5:7989:1874687714938112:0@lo:502: 00000100:00100000:0.0:1787841656.604426:0:7989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841656.604454:0:7989:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cac3324780 going to sleep for 11 seconds 00000100:00100000:3.0:1787841656.605045:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714938112 00000100:00100000:3.0:1787841656.605051:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714938112 00000100:00100000:3.0:1787841656.605079:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787841656.605086:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+14:7989:x1874687714938112:12345-0@lo:502: 00000100:00100000:3.0:1787841656.605694:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+14:7989:x1874687714938112:12345-0@lo:502: Request processed in 605us (1264us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841656.605734:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787841656.607167:0:7989:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf8e82940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f6e7591a-84a0-4774-9d28-b3ed28591dc5:7989:1874687714938112:0@lo:502: 00000040:00080000:1.0:1787841656.607212:0:7989:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1787841656.607278:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1787841656.608680:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787841656.608695:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc6724a00/0xe3dac0c99affe1e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe1e9 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841656.608719:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff92cbc6724a00/0xe3dac0c99affe1e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe1e9 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787841656.608730:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1787841656.608733:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1787841656.608735:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1787841656.608782:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc169be00/0xe3dac0c99affe1f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841656.608791:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff92cbc169be00/0xe3dac0c99affe1f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841656.608800:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff92cbc169be00/0xe3dac0c99affe1f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841656.608831:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf8dc83c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714938240:0@lo:101: 00000100:00100000:1.0:1787841656.608895:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841656.608936:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbf7238a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787841656.616063:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714938240 00000100:00100000:0.0:1787841656.616078:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714938240 00000100:00100000:0.0:1787841656.616128:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787841656.616136:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+14:5836:x1874687714938240:12345-0@lo:101: 00010000:00010000:0.0:1787841656.616165:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841656.616183:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92cbc6725000/0xe3dac0c99affe1f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe3dac0c99affe1f0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841656.616209:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92cbc6725000/0xe3dac0c99affe1f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe3dac0c99affe1f0 expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841656.616220:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92cbc6725000/0xe3dac0c99affe1f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe3dac0c99affe1f0 expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841656.616239:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc6725000, rc 0) 00000100:00100000:0.0:1787841656.616325:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+15:5836:x1874687714938240:12345-0@lo:101: Request processed in 182us (7422us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841656.616333:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787841656.616390:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf8dc83c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714938240:0@lo:101: 00010000:00010000:0.0:1787841656.616411:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff92cbc169be00/0xe3dac0c99affe1f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe1f7 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841656.616421:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff92cbc169be00/0xe3dac0c99affe1f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe3dac0c99affe1f7 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841656.616487:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf8e80b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714938368:0@lo:501: 00000100:00100000:0.0:1787841656.616519:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841656.616548:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cac3324d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787841656.616560:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714938368 00000100:00100000:0.0:1787841656.616564:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714938368 00000100:00100000:0.0:1787841656.616585:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787841656.616591:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+15:5836:x1874687714938368:12345-0@lo:501: 00000100:00100000:0.0:1787841656.616845:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+15:5836:x1874687714938368:12345-0@lo:501: Request processed in 254us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841656.616851:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787841656.618102:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf8e80b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714938368:0@lo:501: 00000100:00100000:0.0:1787841656.618164:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf8e80b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714938496:0@lo:503: 00000100:00100000:0.0:1787841656.618226:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841656.618264:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cac3324d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787841656.618288:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714938496 00000100:00100000:0.0:1787841656.618293:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714938496 00000100:00100000:0.0:1787841656.618356:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787841656.618364:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+15:5836:x1874687714938496:12345-0@lo:503: 00000100:00100000:0.0:1787841656.618684:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+15:5836:x1874687714938496:12345-0@lo:503: Request processed in 320us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841656.618691:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787841656.618751:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf8e80b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714938496:0@lo:503: 00000100:00100000:3.0:1787841656.622338:0:7991:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4bae1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f6e7591a-84a0-4774-9d28-b3ed28591dc5:7991:1874687714938624:0@lo:502: 00000100:00100000:3.0:1787841656.622427:0:7991:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841656.622474:0:7991:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc2e21540 going to sleep for 11 seconds 00000100:00100000:0.0:1787841656.622569:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714938624 00000100:00100000:0.0:1787841656.622576:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714938624 00000100:00100000:0.0:1787841656.622630:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787841656.622639:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+15:7991:x1874687714938624:12345-0@lo:502: 00000100:00100000:0.0:1787841656.622962:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+15:7991:x1874687714938624:12345-0@lo:502: Request processed in 323us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841656.622969:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787841656.623670:0:7991:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4bae1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f6e7591a-84a0-4774-9d28-b3ed28591dc5:7991:1874687714938624:0@lo:502: 00000020:01000000:3.0:1787841656.623719:0:7991:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787841656.623729:0:7991:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787841656.623732:0:7991:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787841656.623737:0:7991:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787841656.623739:0:7991:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1787841656.623760:0:7991:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4bae1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f6e7591a-84a0-4774-9d28-b3ed28591dc5:7991:1874687714938752:0@lo:502: 00000100:00100000:3.0:1787841656.623815:0:7991:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841656.623844:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714938752 00000100:00100000:3.0:1787841656.623849:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714938752 00000100:00100000:3.0:1787841656.623894:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787841656.623902:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+15:7991:x1874687714938752:12345-0@lo:502: 00000100:00100000:3.0:1787841656.624064:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+15:7991:x1874687714938752:12345-0@lo:502: Request processed in 161us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841656.624071:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787841656.624111:0:7991:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc2e21540 going to sleep for 11 seconds 00000100:00100000:3.0:1787841656.624122:0:7991:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4bae1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f6e7591a-84a0-4774-9d28-b3ed28591dc5:7991:1874687714938752:0@lo:502: 00000020:01000000:3.0:1787841656.626084:0:7991:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787841656.626098:0:7991:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787841656.626100:0:7991:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787841656.626106:0:7991:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:0.0:1787841656.626462:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1787841656.626484:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787841656.626495:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc169be00/0xe3dac0c99affe1f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe1f7 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841656.626505:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff92cbc169be00/0xe3dac0c99affe1f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe1f7 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787841656.626516:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787841656.626518:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff92cbc3ed8000 from 30 10000000:01000000:0.0:1787841656.626520:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787841656.626552:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc6725800/0xe3dac0c99affe1fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841656.626579:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff92cbc6725800/0xe3dac0c99affe1fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841656.626591:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff92cbc6725800/0xe3dac0c99affe1fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841656.626616:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf8e80b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714938880:0@lo:101: 00000100:00100000:0.0:1787841656.626692:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841656.626767:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cac3324900 going to sleep for 11 seconds 00000100:00100000:0.0:1787841656.626800:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714938880 00000100:00100000:0.0:1787841656.626806:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714938880 00000100:00100000:0.0:1787841656.626847:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787841656.626855:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+15:5836:x1874687714938880:12345-0@lo:101: 00010000:00010000:0.0:1787841656.626868:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841656.626880:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92cbc6725a00/0xe3dac0c99affe205 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe3dac0c99affe1fe expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841656.626904:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92cbc6725a00/0xe3dac0c99affe205 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe3dac0c99affe1fe expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841656.626915:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92cbc6725a00/0xe3dac0c99affe205 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe3dac0c99affe1fe expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841656.626924:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc6725a00, rc 0) 00000100:00100000:0.0:1787841656.626959:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+16:5836:x1874687714938880:12345-0@lo:101: Request processed in 105us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841656.626965:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787841656.627007:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf8e80b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714938880:0@lo:101: 00010000:00010000:0.0:1787841656.627028:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff92cbc6725800/0xe3dac0c99affe1fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe205 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841656.627037:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff92cbc6725800/0xe3dac0c99affe1fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xe3dac0c99affe205 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841656.627080:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf8e80b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714939008:0@lo:501: 00000100:00100000:0.0:1787841656.627106:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841656.627118:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cac3324900 going to sleep for 11 seconds 00000100:00100000:0.0:1787841656.627127:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714939008 00000100:00100000:0.0:1787841656.627130:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714939008 00000100:00100000:0.0:1787841656.628258:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787841656.628269:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+16:5836:x1874687714939008:12345-0@lo:501: 00000100:00100000:0.0:1787841656.628556:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+16:5836:x1874687714939008:12345-0@lo:501: Request processed in 289us (1447us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841656.628564:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787841656.641502:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf8e80b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714939008:0@lo:501: 00000100:00100000:3.0:1787841656.641569:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4bae1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714939136:0@lo:503: 00000100:00100000:3.0:1787841656.641661:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841656.641731:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc2e21540 going to sleep for 11 seconds 00000100:00100000:0.0:1787841656.641974:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714939136 00000100:00100000:0.0:1787841656.641981:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714939136 00000100:00100000:0.0:1787841656.642043:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787841656.642053:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+16:5836:x1874687714939136:12345-0@lo:503: 00000100:00100000:0.0:1787841656.642266:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+16:5836:x1874687714939136:12345-0@lo:503: Request processed in 213us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841656.642274:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787841656.642420:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4bae1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714939136:0@lo:503: 00000100:00100000:0.0:1787841656.649044:0:7993:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf8e80000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f6e7591a-84a0-4774-9d28-b3ed28591dc5:7993:1874687714939264:0@lo:502: 00000100:00100000:0.0:1787841656.649133:0:7993:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841656.649396:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714939264 00000100:00100000:0.0:1787841656.649404:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714939264 00000100:00100000:0.0:1787841656.649462:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787841656.649471:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+16:7993:x1874687714939264:12345-0@lo:502: 00000100:00100000:0.0:1787841656.649732:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+16:7993:x1874687714939264:12345-0@lo:502: Request processed in 262us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841656.649740:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787841656.649788:0:7993:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cac3324900 going to sleep for 11 seconds 00000100:00100000:0.0:1787841656.649810:0:7993:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf8e80000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f6e7591a-84a0-4774-9d28-b3ed28591dc5:7993:1874687714939264:0@lo:502: 00000100:00100000:0.0:1787841656.649859:0:7993:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf8e80000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f6e7591a-84a0-4774-9d28-b3ed28591dc5:7993:1874687714939392:0@lo:502: 00000100:00100000:0.0:1787841656.649892:0:7993:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841656.649913:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714939392 00000100:00100000:0.0:1787841656.649917:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714939392 00000100:00100000:0.0:1787841656.649935:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787841656.649941:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+16:7993:x1874687714939392:12345-0@lo:502: 00000100:00100000:0.0:1787841656.650060:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+16:7993:x1874687714939392:12345-0@lo:502: Request processed in 119us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841656.650067:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787841656.650095:0:7993:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cac3324900 going to sleep for 11 seconds 00000100:00100000:0.0:1787841656.650107:0:7993:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf8e80000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f6e7591a-84a0-4774-9d28-b3ed28591dc5:7993:1874687714939392:0@lo:502: 00000040:00080000:0.0:1787841656.650125:0:7993:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1787841656.654443:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1787841656.654495:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787841656.654512:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc6725800/0xe3dac0c99affe1fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe205 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841656.654547:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff92cbc6725800/0xe3dac0c99affe1fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe205 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787841656.654560:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787841656.654564:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff92cbc3ed8000 from 5 10000000:01000000:1.0:1787841656.654567:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787841656.654619:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc169b000/0xe3dac0c99affe20c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841656.654628:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff92cbc169b000/0xe3dac0c99affe20c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841656.654641:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff92cbc169b000/0xe3dac0c99affe20c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841656.654671:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf8dca580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714939520:0@lo:101: 00000100:00100000:1.0:1787841656.655001:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841656.655055:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbf7238a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787841656.656805:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714939520 00000100:00100000:0.0:1787841656.656824:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714939520 00000100:00100000:0.0:1787841656.656914:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787841656.656926:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+16:5836:x1874687714939520:12345-0@lo:101: 00010000:00010000:0.0:1787841656.656944:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841656.656968:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92cbc6724e00/0xe3dac0c99affe213 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe3dac0c99affe20c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841656.657022:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92cbc6724e00/0xe3dac0c99affe213 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe3dac0c99affe20c expref: 17 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841656.657034:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92cbc6724e00/0xe3dac0c99affe213 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe3dac0c99affe20c expref: 17 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841656.657044:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc6724e00, rc 0) 00000100:00100000:0.0:1787841656.657137:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+17:5836:x1874687714939520:12345-0@lo:101: Request processed in 214us (2136us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841656.657157:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787841656.657217:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf8dca580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714939520:0@lo:101: 00010000:00010000:0.0:1787841656.657235:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff92cbc169b000/0xe3dac0c99affe20c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe213 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841656.657245:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff92cbc169b000/0xe3dac0c99affe20c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe3dac0c99affe213 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841656.657313:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf8e80000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714939648:0@lo:256: 00000100:00100000:0.0:1787841656.657361:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841656.657389:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc942b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787841656.657402:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714939648 00000100:00100000:0.0:1787841656.657407:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714939648 00000100:00100000:0.0:1787841656.657425:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787841656.657431:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+17:5836:x1874687714939648:12345-0@lo:256: 20000000:01000000:0.0:1787841656.657444:0:5832:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787841656.657461:0:5832:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787841656.657464:0:5832:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1787841656.657541:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+17:5836:x1874687714939648:12345-0@lo:256: Request processed in 109us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841656.657548:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787841656.657573:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf8e80000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714939648:0@lo:256: 10000000:01000000:0.0:1787841656.657609:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787841656.657616:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc169b000/0xe3dac0c99affe20c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe213 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841656.657623:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff92cbc169b000/0xe3dac0c99affe20c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe213 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787841656.657631:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1787841656.657635:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1787841656.657638:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787841656.657655:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc6724c00/0xe3dac0c99affe21a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841656.657662:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff92cbc6724c00/0xe3dac0c99affe21a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841656.657669:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff92cbc6724c00/0xe3dac0c99affe21a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841656.657679:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf8e80000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714939776:0@lo:101: 00000100:00100000:0.0:1787841656.657730:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841656.657746:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc942b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787841656.657756:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714939776 00000100:00100000:0.0:1787841656.657759:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714939776 00000100:00100000:0.0:1787841656.657776:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787841656.657782:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+17:5836:x1874687714939776:12345-0@lo:101: 00010000:00010000:0.0:1787841656.657793:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841656.657801:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92cbc6724800/0xe3dac0c99affe221 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xe3dac0c99affe21a expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841656.657816:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92cbc6724800/0xe3dac0c99affe221 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe3dac0c99affe21a expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841656.657824:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92cbc6724800/0xe3dac0c99affe221 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe3dac0c99affe21a expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841656.657830:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc6724800, rc 0) 00000100:00100000:0.0:1787841656.657858:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+18:5836:x1874687714939776:12345-0@lo:101: Request processed in 76us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841656.657864:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787841656.657890:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf8e80000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714939776:0@lo:101: 00010000:00010000:0.0:1787841656.657899:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff92cbc6724c00/0xe3dac0c99affe21a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe221 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841656.657906:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff92cbc6724c00/0xe3dac0c99affe21a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xe3dac0c99affe221 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841656.657951:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf8e80000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714939904:0@lo:501: 00000100:00100000:0.0:1787841656.657978:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841656.657991:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc942b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787841656.658001:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714939904 00000100:00100000:0.0:1787841656.658004:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714939904 00000100:00100000:0.0:1787841656.658019:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787841656.658024:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+18:5836:x1874687714939904:12345-0@lo:501: 00000100:00100000:0.0:1787841656.658269:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+18:5836:x1874687714939904:12345-0@lo:501: Request processed in 243us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841656.658276:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787841656.658306:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf8e80000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714939904:0@lo:501: 00000100:00100000:0.0:1787841656.665041:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf8e80000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714940032:0@lo:503: 00000100:00100000:0.0:1787841656.665140:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841656.666955:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc942b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787841656.667853:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714940032 00000100:00100000:2.0:1787841656.667865:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714940032 00000100:00100000:2.0:1787841656.669735:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787841656.669761:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+18:5836:x1874687714940032:12345-0@lo:503: 00000100:00100000:2.0:1787841656.670218:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+18:5836:x1874687714940032:12345-0@lo:503: Request processed in 468us (5076us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841656.670234:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787841656.675150:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf8e80000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714940032:0@lo:503: 00000100:00100000:1.0:1787841656.686657:0:7994:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf8dc8b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f6e7591a-84a0-4774-9d28-b3ed28591dc5:7994:1874687714940160:0@lo:502: 00000100:00100000:1.0:1787841656.686841:0:7994:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841656.686906:0:7994:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbf7238a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787841656.690135:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714940160 00000100:00100000:3.0:1787841656.690160:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714940160 00000100:00100000:3.0:1787841656.690238:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787841656.690247:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+18:7994:x1874687714940160:12345-0@lo:502: 00000100:00100000:3.0:1787841656.690651:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+18:7994:x1874687714940160:12345-0@lo:502: Request processed in 405us (3812us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841656.690661:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787841656.690760:0:7994:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf8dc8b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f6e7591a-84a0-4774-9d28-b3ed28591dc5:7994:1874687714940160:0@lo:502: 00000020:01000000:1.0:1787841656.690828:0:7994:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787841656.690841:0:7994:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1787841656.690854:0:7994:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787841656.690857:0:7994:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1787841656.690868:0:7994:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787841656.690872:0:7994:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.101@tcp to nid 0x20000c0a8c965 (192.168.201.101@tcp) 00000020:01000000:1.0:1787841656.690914:0:7994:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787841656.690917:0:7994:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787841656.690939:0:7994:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff92cbf8e24ed8) 00000020:00000080:1.0:1787841656.690970:0:7994:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1787841656.690978:0:7994:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787841656.691273:0:7994:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1787841656.691280:0:7994:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:1.0:1787841656.691288:0:7994:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe3dac0c99affe22f 00010000:00080000:1.0:1787841656.691345:0:7994:0:(ldlm_lib.c:102:import_set_conn()) imp ffff92cbffa70000@lustre-OST0001-osc-MDT0000: add connection 192.168.201.101@tcp at head 00010000:00010000:1.0:1787841656.691911:0:7994:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:0.0:1787841656.693959:0:7994:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1787841656.693981:0:7994:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1787841656.694571:0:7994:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787841656.694868:0:7994:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787841656.694925:0:7994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1787841656.694987:0:7994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1787841656.705536:0:7996:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787841656.705548:0:7996:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1787841656.714788:0:7994:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787841656.714804:0:7994:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787841656.714850:0:7994:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1787841656.714878:0:7994:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe3dac0c99affe236 00000100:00080000:2.0:1787841656.714890:0:7994:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787841656.714897:0:7994:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff92cbffa70000 using connection 192.168.201.101@tcp/0@lo 00000100:00100000:2.0:1787841656.714934:0:7994:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92cbf07fa580 x1874687714940288/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787841656.714962:0:7994:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:0.0:1787841656.715025:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf07fa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1874687714940288:0@lo:8: 00000020:01000000:2.0:1787841656.715036:0:7994:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787841656.715042:0:7994:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787841656.715044:0:7994:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1787841656.715048:0:7994:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787841656.715053:0:7994:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787841656.715055:0:7994:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787841656.715060:0:7994:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787841656.715063:0:7994:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787841656.715099:0:7994:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf07fad00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f6e7591a-84a0-4774-9d28-b3ed28591dc5:7994:1874687714940416:0@lo:502: 00000100:00100000:0.0:1787841656.715154:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841656.715242:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714940288 00000100:00100000:0.0:1787841656.715252:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714940288 00000100:00100000:2.0:1787841656.715254:0:7994:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841656.715302:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714940416 00000100:00100000:0.0:1787841656.715307:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787841656.715312:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714940416 00000100:00100000:0.0:1787841656.715330:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf8e80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3297:x1874687714940288:12345-0@lo:8: 00010000:00080000:0.0:1787841656.715369:0:6687:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 196 last 0 00000100:00100000:2.0:1787841656.715384:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787841656.715395:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+18:7994:x1874687714940416:12345-0@lo:502: 00000020:00000080:0.0:1787841656.715409:0:6687:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe3dac0c99affe23d 00002000:00100000:0.0:1787841656.715429:0:6687:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff92cac12d1800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211395f ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1787841656.715435:0:6687:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:0.0:1787841656.715440:0:6687:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1787841656.715665:0:6687:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:2.0:1787841656.716013:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+18:7994:x1874687714940416:12345-0@lo:502: Request processed in 617us (758us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841656.716024:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00002000:00080000:0.0:1787841656.716064:0:6687:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787841656.716105:0:6687:0:(import.c:65:import_set_state_nolock()) ffff92cac12d4800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787841656.716112:0:7994:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbf046f780 going to sleep for 11 seconds 00000100:00100000:0.0:1787841656.716175:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf8e80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3297:x1874687714940288:12345-0@lo:8: Request processed in 855us (1020us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841656.716185:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1787841656.716234:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbf07fa580 x1874687714940288/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787841666 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787841656.716246:0:3297:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787841656.716254:0:3297:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1787841656.716263:0:3297:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787841656.716270:0:3297:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1787841656.716272:0:3297:0:(import.c:65:import_set_state_nolock()) ffff92cbffa70000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787841656.716283:0:3297:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787841656.716289:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf07fa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1874687714940288:0@lo:8: 00000100:00100000:1.0:1787841656.719457:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf8dcb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1874687714940672:0@lo:400: 00000100:00100000:1.0:1787841656.719548:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841656.719595:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787841656.719602:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf8dca580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874687714940800:0@lo:400: 00000100:00100000:1.0:1787841656.719632:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841656.719684:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714940672 00000100:00100000:1.0:1787841656.719693:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714940672 00000100:00100000:1.0:1787841656.719782:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787841656.719794:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf8dcad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874687714940672:12345-0@lo:400: 00000100:00100000:1.0:1787841656.719856:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf8dcad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874687714940672:12345-0@lo:400: Request processed in 65us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841656.719864:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787841656.719895:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714940800 00000100:00100000:1.0:1787841656.719900:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714940800 00000100:00100000:1.0:1787841656.719930:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787841656.719937:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf8dc9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1874687714940800:12345-0@lo:400: 00000100:00100000:1.0:1787841656.720003:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf8dc9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1874687714940800:12345-0@lo:400: Request processed in 66us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841656.720010:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1787841656.720057:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbf8dca580 x1874687714940800/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787841672 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787841656.720072:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf8dca580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874687714940800:0@lo:400: 00010000:00080000:1.0:1787841656.720097:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbf8dcb0c0 x1874687714940672/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787841672 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787841656.720108:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf8dcb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1874687714940672:0@lo:400: 00000004:00080000:1.0:1787841656.720138:0:7996:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:2.0:1787841656.720352:0:7994:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf07fad00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f6e7591a-84a0-4774-9d28-b3ed28591dc5:7994:1874687714940416:0@lo:502: 00000100:00100000:2.0:1787841656.720433:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf8dc8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874687714940544:0@lo:400: 00000100:00100000:2.0:1787841656.720516:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1787841656.720519:0:7996:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 196718819227ns, next at 0ns, rc = 0 00000100:00100000:2.0:1787841656.720560:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787841656.720570:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf8dc83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1874687714940928:0@lo:400: 00000100:00100000:2.0:1787841656.720595:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841656.720659:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714940544 00000100:00100000:2.0:1787841656.720666:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714940544 00000100:00100000:2.0:1787841656.720725:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714940928 00000100:00100000:2.0:1787841656.720728:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714940928 00000100:00100000:2.0:1787841656.720748:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787841656.720755:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf07fad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874687714940544:12345-0@lo:400: 00000100:00100000:2.0:1787841656.720803:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf07fad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874687714940544:12345-0@lo:400: Request processed in 48us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841656.720810:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787841656.720827:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787841656.720833:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf07f92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1874687714940928:12345-0@lo:400: 00000100:00100000:2.0:1787841656.720857:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf07f92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1874687714940928:12345-0@lo:400: Request processed in 25us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841656.720863:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1787841656.720891:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbf8dc83c0 x1874687714940928/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787841672 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787841656.720902:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf8dc83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1874687714940928:0@lo:400: 00010000:00080000:2.0:1787841656.720910:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbf8dc8b40 x1874687714940544/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787841672 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787841656.720917:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf8dc8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874687714940544:0@lo:400: 00000020:01000000:2.0:1787841656.720951:0:7994:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787841656.720958:0:7994:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787841656.720960:0:7994:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787841656.720966:0:7994:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:2.0:1787841656.721034:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:2.0:1787841656.721062:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787841656.721072:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc6724c00/0xe3dac0c99affe21a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe221 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841656.721082:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff92cbc6724c00/0xe3dac0c99affe21a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe221 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787841656.721092:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1787841656.721095:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff92cbe9a69a48 from 1 10000000:01000000:2.0:1787841656.721097:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787841656.721126:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc6599600/0xe3dac0c99affe244 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841656.721133:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff92cbc6599600/0xe3dac0c99affe244 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841656.721156:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff92cbc6599600/0xe3dac0c99affe244 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841656.721175:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf07fbc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714941056:0@lo:101: 00000100:00100000:2.0:1787841656.721216:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841656.721265:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbf046f780 going to sleep for 11 seconds 00000100:00100000:2.0:1787841656.724314:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714941056 00000100:00100000:2.0:1787841656.724335:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714941056 00000100:00100000:2.0:1787841656.724397:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787841656.724408:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+18:5836:x1874687714941056:12345-0@lo:101: 00010000:00010000:2.0:1787841656.724439:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841656.724459:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92cbc6598000/0xe3dac0c99affe24b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xe3dac0c99affe244 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841656.724490:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92cbc6598000/0xe3dac0c99affe24b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe3dac0c99affe244 expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841656.724503:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92cbc6598000/0xe3dac0c99affe24b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe3dac0c99affe244 expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841656.724512:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc6598000, rc 0) 00000100:00100000:2.0:1787841656.724598:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:5836:x1874687714941056:12345-0@lo:101: Request processed in 191us (3383us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841656.724607:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787841656.724680:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf07fbc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714941056:0@lo:101: 00010000:00010000:2.0:1787841656.724726:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff92cbc6599600/0xe3dac0c99affe244 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe24b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841656.724736:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff92cbc6599600/0xe3dac0c99affe244 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xe3dac0c99affe24b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841656.724807:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf07fbc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714941184:0@lo:501: 00000100:00100000:2.0:1787841656.724839:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841656.724866:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbf046f780 going to sleep for 11 seconds 00000100:00100000:2.0:1787841656.727404:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714941184 00000100:00100000:2.0:1787841656.727414:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714941184 00000100:00100000:2.0:1787841656.727479:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787841656.727488:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:5836:x1874687714941184:12345-0@lo:501: 00000100:00100000:2.0:1787841656.727910:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:5836:x1874687714941184:12345-0@lo:501: Request processed in 422us (3069us total) trans 0 rc -2/-2 00000100:00080000:0.0:1787841656.727921:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787841656.727922:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:0.0:1787841656.727935:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787841656.728008:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf07fbc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714941184:0@lo:501: 10000000:01000000:2.0:1787841656.728047:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787841656.728056:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc6599600/0xe3dac0c99affe244 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe24b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841656.728067:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff92cbc6599600/0xe3dac0c99affe244 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe24b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787841656.799990:0:7997:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:1.0:1787841656.800446:0:7997:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf8dca580 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7997:1874687714941440:0@lo:7: 00000100:00100000:1.0:1787841656.800616:0:7997:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841656.800687:0:7997:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbf6a14a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787841656.800790:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714941440 00000100:00100000:1.0:1787841656.800797:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714941440 00000100:00100000:1.0:1787841656.800857:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787841656.800866:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf8dc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7997:x1874687714941440:12345-0@lo:7: 00000100:00100000:2.0:1787841656.804029:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf8dcb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874687714941312:0@lo:13: 00000100:00100000:2.0:1787841656.804387:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841656.804565:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714941312 00000100:00100000:2.0:1787841656.804576:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714941312 00000100:00100000:2.0:1787841656.804726:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787841656.804738:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf07fbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3299:x1874687714941312:12345-0@lo:13: 00002000:00000024:2.0:1787841656.804788:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1787841656.804845:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf07fbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3299:x1874687714941312:12345-0@lo:13: Request processed in 109us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841656.804853:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1787841656.817908:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbf8dcb0c0 x1874687714941312/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841672 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787841656.817946:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf8dcb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874687714941312:0@lo:13: 00000100:00080000:0.0:1787841656.829411:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:2.0:1787841656.857086:0:6686:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:2.0:1787841656.857096:0:6686:0:(ofd_dev.c:1211:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:2.0:1787841656.857215:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf8dc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7997:x1874687714941440:12345-0@lo:7: Request processed in 56344us (56594us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841656.857230:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1787841656.861796:0:7997:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbf8dca580 x1874687714941440/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787841672 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787841656.861818:0:7997:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf8dca580 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7997:1874687714941440:0@lo:7: 00000004:00080000:1.0:1787841656.861837:0:7997:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:1.0:1787841656.861883:0:7997:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf8dca580 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7997:1874687714941568:0@lo:5: 00000100:00100000:1.0:1787841656.861962:0:7997:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841656.862028:0:7997:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbf6a14a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787841656.862984:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714941568 00000100:00100000:0.0:1787841656.863004:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714941568 00000100:00100000:0.0:1787841656.863091:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787841656.863104:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf8dca940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7997:x1874687714941568:12345-0@lo:5: 00002000:00080000:0.0:1787841656.863159:0:6687:0:(ofd_dev.c:1643:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1787841656.863165:0:6687:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1787841656.864695:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf8dca940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:7997:x1874687714941568:12345-0@lo:5: Request processed in 1586us (2724us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1787841656.864725:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1787841656.865861:0:7997:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbf8dca580 x1874687714941568/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787841672 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787841656.865907:0:7997:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf8dca580 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7997:1874687714941568:0@lo:5: 00000004:00080000:0.0:1787841656.865926:0:7997:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1787841656.865985:0:7997:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf8e82580 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7997:1874687714941696:0@lo:700: 00000100:00100000:0.0:1787841656.866045:0:7997:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841656.866080:0:7997:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cac3324780 going to sleep for 11 seconds 00000100:00100000:0.0:1787841656.866104:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714941696 00000100:00100000:0.0:1787841656.866820:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714941696 00000100:00100000:0.0:1787841656.866900:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787841656.866912:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf8e803c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7997:x1874687714941696:12345-0@lo:700: 00000100:00100000:0.0:1787841656.866972:0:6695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf8e82d00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6695:1874687714941824:0@lo:700: 00000100:00100000:0.0:1787841656.867028:0:6695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841656.867065:0:6695:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cac3324900 going to sleep for 11 seconds 00000100:00100000:0.0:1787841656.868057:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714941824 00000100:00100000:0.0:1787841656.868069:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714941824 00000100:00100000:3.0:1787841656.870372:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787841656.870392:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf8e812c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0001:lustre-MDT0000-lwp-OST0001_UUID+5:6695:x1874687714941824:12345-0@lo:700: 00000004:00080000:1.0:1787841656.974421:0:5860:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 40000000:02000000:0.0:1787841657.032295:0:5845:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:1.0:1787841657.050471:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf8e812c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0001:lustre-MDT0000-lwp-OST0001_UUID+5:6695:x1874687714941824:12345-0@lo:700: Request processed in 180074us (183429us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841657.050491:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787841657.050626:0:6695:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbf8e82d00 x1874687714941824/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787841672 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787841657.050647:0:6695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf8e82d00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6695:1874687714941824:0@lo:700: 40000000:02000000:0.0:1787841657.050667:0:6695:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00080000:3.0:1787841657.209894:0:7643:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:3.0:1787841657.209918:0:7643:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1787841657.213545:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf8e803c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7997:x1874687714941696:12345-0@lo:700: Request processed in 346625us (347489us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841657.213561:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787841657.213654:0:7997:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbf8e82580 x1874687714941696/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787841672 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787841657.213672:0:7997:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1787841657.213744:0:7997:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf8e82580 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7997:1874687714941696:0@lo:700: 00000004:02000040:1.0:1787841657.267289:0:7997:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:1.0:1787841657.279438:0:7997:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf8dca580 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7997:1874687714941952:0@lo:5: 00000100:00100000:1.0:1787841657.279536:0:7997:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841657.279656:0:7997:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbf6a14c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787841657.287555:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714941952 00000100:00100000:0.0:1787841657.287582:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714941952 00000100:00100000:0.0:1787841657.297907:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787841657.297947:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf8dc9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:7997:x1874687714941952:12345-0@lo:5: 00002000:00080000:1.0:1787841657.312610:0:6686:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1787841657.312633:0:6686:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:1.0:1787841657.318547:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf8dc9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7997:x1874687714941952:12345-0@lo:5: Request processed in 20615us (39002us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1787841657.318561:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1787841657.318666:0:7997:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbf8dca580 x1874687714941952/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787841673 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787841657.318687:0:7997:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf8dca580 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7997:1874687714941952:0@lo:5: 00000004:00080000:2.0:1787841657.318792:0:7997:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:3.0:1787841657.410226:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787841658.113052:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf07f8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874687714942080:0@lo:13: 00000100:00100000:1.0:1787841658.113124:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841658.113235:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714942080 00000100:00100000:2.0:1787841658.113243:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714942080 00000100:00100000:2.0:1787841658.113322:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787841658.113332:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf8dcb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874687714942080:12345-0@lo:13: 00002000:00000024:2.0:1787841658.113372:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787841658.113418:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf8dcb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874687714942080:12345-0@lo:13: Request processed in 89us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841658.113425:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1787841658.113564:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787841658.113617:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbf07f8780 x1874687714942080/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841674 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787841658.113635:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf07f8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874687714942080:0@lo:13: 00010000:00010000:1.0:1787841658.434963:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841659.457045:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841660.490821:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841661.508935:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787841662.208876:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787841662.208906:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf07f9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874687714942208:0@lo:13: 00000100:00100000:2.0:1787841662.208987:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841662.209514:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714942208 00000100:00100000:2.0:1787841662.209524:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714942208 00000100:00100000:2.0:1787841662.209595:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787841662.209603:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf07f9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1874687714942208:12345-0@lo:13: 00002000:00000024:2.0:1787841662.209643:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787841662.209733:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf07f9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1874687714942208:12345-0@lo:13: Request processed in 130us (746us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841662.209741:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1787841662.209828:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbf07f9680 x1874687714942208/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841678 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787841662.209847:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf07f9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874687714942208:0@lo:13: 00000100:00080000:3.0:1787841662.210829:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787841662.211509:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf8e83c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3298:1874687714942336:0@lo:400: 00000100:00100000:3.0:1787841662.211576:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841662.211622:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf8e821c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1874687714942848:0@lo:400: 00000100:00100000:3.0:1787841662.211654:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841662.211676:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787841662.211682:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf8e80780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874687714942464:0@lo:400: 00000100:00100000:3.0:1787841662.211732:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841662.211892:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf8e81a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874687714942720:0@lo:400: 00000100:00100000:0.0:1787841662.211926:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841662.211952:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787841662.211958:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf8e81680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1874687714942592:0@lo:400: 00000100:00100000:0.0:1787841662.211979:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841662.212009:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714942848 00000100:00100000:0.0:1787841662.212015:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714942848 00000100:00100000:2.0:1787841662.212548:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714942336 00000100:00100000:2.0:1787841662.212553:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714942336 00000100:00100000:2.0:1787841662.212595:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787841662.212605:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:3298:x1874687714942336:12345-0@lo:400: 00000100:00100000:2.0:1787841662.212656:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:3298:x1874687714942336:12345-0@lo:400: Request processed in 53us (1080us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841662.212663:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787841662.212693:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714942464 00000100:00100000:2.0:1787841662.212722:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714942464 00000100:00100000:3.0:1787841662.212776:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714942720 00000100:00100000:3.0:1787841662.212780:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714942720 00000100:00100000:3.0:1787841662.212819:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787841662.212826:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf8e80f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1874687714942720:12345-0@lo:400: 00000100:00100000:3.0:1787841662.212867:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf8e80f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1874687714942720:12345-0@lo:400: Request processed in 41us (941us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841662.212873:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1787841662.212893:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787841662.213163:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714942592 00000100:00100000:0.0:1787841662.213168:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714942592 00000100:00100000:2.0:1787841662.214547:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787841662.214558:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbd4baed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1874687714942848:12345-0@lo:400: 00000100:00100000:2.0:1787841662.214625:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbd4baed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1874687714942848:12345-0@lo:400: Request processed in 69us (2970us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841662.214633:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787841662.214649:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787841662.214655:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbd4bad680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874687714942464:12345-0@lo:400: 00000100:00100000:2.0:1787841662.214682:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbd4bad680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874687714942464:12345-0@lo:400: Request processed in 28us (2950us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841662.214688:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:2.0:1787841662.217335:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbf8e80780 x1874687714942464/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787841678 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787841662.217363:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf8e80780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874687714942464:0@lo:400: 00000100:00080000:3.0:1787841662.217458:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787841662.225406:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbf8e81a40 x1874687714942720/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787841678 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787841662.225439:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf8e81a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874687714942720:0@lo:400: 00000100:00100000:0.0:1787841662.225820:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787841662.225833:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf8e83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874687714942592:12345-0@lo:400: 00000100:00100000:0.0:1787841662.225924:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf8e83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874687714942592:12345-0@lo:400: Request processed in 95us (13943us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841662.225930:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1787841662.225965:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbf8e81680 x1874687714942592/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787841678 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787841662.225976:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf8e81680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1874687714942592:0@lo:400: 00000100:00100000:2.0:1787841662.233158:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf8e83c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3298:1874687714942336:0@lo:400: 00010000:00080000:2.0:1787841662.257163:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbf8e821c0 x1874687714942848/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787841678 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787841662.257185:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf8e821c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1874687714942848:0@lo:400: 00000001:00080000:1.0:1787841662.306559:0:7643:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:1.0:1787841662.529671:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787841663.232932:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787841663.232976:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf07f9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687714942976:0@lo:13: 00000100:00100000:3.0:1787841663.233093:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841663.233231:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714942976 00000100:00100000:2.0:1787841663.233244:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714942976 00000100:00100000:2.0:1787841663.233383:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787841663.233397:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbd4bac3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874687714942976:12345-0@lo:13: 00002000:00000024:2.0:1787841663.233455:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787841663.233512:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbd4bac3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874687714942976:12345-0@lo:13: Request processed in 118us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841663.233519:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1787841663.233617:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbf07f9680 x1874687714942976/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841679 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787841663.233641:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf07f9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687714942976:0@lo:13: 00010000:00010000:3.0:1787841663.553768:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787841664.144646:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841664.149996:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687694995840 00000100:00100000:0.0:1787841664.150023:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687694995840 00000100:00100000:0.0:1787841664.150114:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 113 00000100:00100000:0.0:1787841664.150126:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2353:x1874687694995840:12345-192.168.201.1@tcp:250: 00010000:00080000:0.0:1787841664.150187:0:5833:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from 09a1f1ce-26b5-4cc6-a1db-8e09063432da@192.168.201.1@tcp t0 exp 0000000000000000 cur 204 last 0 00000020:00000080:0.0:1787841664.150235:0:5833:0:(genops.c:1385:class_connect()) connect: client 09a1f1ce-26b5-4cc6-a1db-8e09063432da, cookie 0xe3dac0c99affe252 00000100:00080000:0.0:1787841664.150467:0:5833:0:(import.c:65:import_set_state_nolock()) ffff92cac12d1000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787841664.150586:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a1f1ce-26b5-4cc6-a1db-8e09063432da+5:2353:x1874687694995840:12345-192.168.201.1@tcp:250: Request processed in 461us (6320us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841664.150596:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 113 00000100:00100000:3.0:1787841664.160672:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841664.160914:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687694995712 00000100:00100000:2.0:1787841664.160929:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687694995712 00000100:00100000:2.0:1787841664.161024:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 114 00000100:00100000:2.0:1787841664.161037:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a1f1ce-26b5-4cc6-a1db-8e09063432da+5:5593:x1874687694995712:12345-192.168.201.1@tcp:101: 00010000:00010000:2.0:1787841664.161064:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841664.161092:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92cbc6598800/0xe3dac0c99affe259 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6699 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841664.161132:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92cbc6598800/0xe3dac0c99affe259 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6699 expref: 6 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841664.161163:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92cbc6598800/0xe3dac0c99affe259 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6699 expref: 6 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841664.161174:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc6598800, rc 0) 00000100:00100000:2.0:1787841664.161259:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a1f1ce-26b5-4cc6-a1db-8e09063432da+6:5593:x1874687694995712:12345-192.168.201.1@tcp:101: Request processed in 223us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841664.161265:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 114 00000100:00100000:1.0:1787841664.164488:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841664.164768:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687694995968 00000100:00100000:3.0:1787841664.164781:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687694995968 00000100:00100000:3.0:1787841664.164902:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 115 00000100:00100000:3.0:1787841664.164914:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a1f1ce-26b5-4cc6-a1db-8e09063432da+6:5593:x1874687694995968:12345-192.168.201.1@tcp:501: 00000100:00100000:3.0:1787841664.168637:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a1f1ce-26b5-4cc6-a1db-8e09063432da+6:5593:x1874687694995968:12345-192.168.201.1@tcp:501: Request processed in 3700us (4145us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787841664.168691:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 115 00000100:00100000:1.0:1787841664.176065:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841664.176213:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687694996096 00000100:00100000:3.0:1787841664.176227:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687694996096 00000100:00100000:3.0:1787841664.176419:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 116 00000100:00100000:3.0:1787841664.176441:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a1f1ce-26b5-4cc6-a1db-8e09063432da+6:5593:x1874687694996096:12345-192.168.201.1@tcp:101: 00010000:00010000:3.0:1787841664.176467:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841664.176494:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92cbc149c600/0xe3dac0c99affe260 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d66a0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841664.176534:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92cbc149c600/0xe3dac0c99affe260 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d66a0 expref: 7 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841664.176549:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92cbc149c600/0xe3dac0c99affe260 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d66a0 expref: 7 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841664.176561:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc149c600, rc 0) 00000100:00100000:3.0:1787841664.176652:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a1f1ce-26b5-4cc6-a1db-8e09063432da+7:5593:x1874687694996096:12345-192.168.201.1@tcp:101: Request processed in 213us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841664.176660:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 116 00000100:00100000:1.0:1787841664.180357:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841664.180531:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687694996224 00000100:00100000:3.0:1787841664.180544:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687694996224 00000100:00100000:3.0:1787841664.180873:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 117 00000100:00100000:3.0:1787841664.180887:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a1f1ce-26b5-4cc6-a1db-8e09063432da+7:5593:x1874687694996224:12345-192.168.201.1@tcp:501: 00000100:00100000:3.0:1787841664.183714:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a1f1ce-26b5-4cc6-a1db-8e09063432da+8:5593:x1874687694996224:12345-192.168.201.1@tcp:501: Request processed in 2801us (3345us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841664.183732:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 117 00000100:00100000:1.0:1787841664.187939:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841664.188109:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687694996352 00000100:00100000:3.0:1787841664.188142:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687694996352 00000100:00100000:3.0:1787841664.189646:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 118 00000100:00100000:3.0:1787841664.189682:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a1f1ce-26b5-4cc6-a1db-8e09063432da+8:5593:x1874687694996352:12345-192.168.201.1@tcp:503: 00000100:00100000:3.0:1787841664.191404:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a1f1ce-26b5-4cc6-a1db-8e09063432da+8:5593:x1874687694996352:12345-192.168.201.1@tcp:503: Request processed in 1728us (3470us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841664.191420:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 118 00000100:00100000:1.0:1787841664.196394:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841664.197927:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687694996480 00000100:00100000:3.0:1787841664.197945:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687694996480 00000100:00100000:3.0:1787841664.198045:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 119 00000100:00100000:3.0:1787841664.198057:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a1f1ce-26b5-4cc6-a1db-8e09063432da+8:5613:x1874687694996480:12345-192.168.201.1@tcp:502: 00000100:00100000:0.0:1787841664.202003:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a1f1ce-26b5-4cc6-a1db-8e09063432da+8:5613:x1874687694996480:12345-192.168.201.1@tcp:502: Request processed in 3931us (5608us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841664.202024:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 119 00000100:00100000:1.0:1787841664.237964:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841664.238117:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687694996608 00000100:00100000:3.0:1787841664.238132:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687694996608 00000100:00100000:3.0:1787841664.238225:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 120 00000100:00100000:3.0:1787841664.238237:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a1f1ce-26b5-4cc6-a1db-8e09063432da+8:5613:x1874687694996608:12345-192.168.201.1@tcp:502: 00000100:00100000:3.0:1787841664.238640:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a1f1ce-26b5-4cc6-a1db-8e09063432da+8:5613:x1874687694996608:12345-192.168.201.1@tcp:502: Request processed in 403us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841664.238650:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 120 00000100:00100000:1.0:1787841664.253821:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841664.253933:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687694996736 00000100:00100000:0.0:1787841664.253948:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687694996736 00000100:00100000:0.0:1787841664.254090:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 121 00000100:00100000:0.0:1787841664.254103:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a1f1ce-26b5-4cc6-a1db-8e09063432da+8:5593:x1874687694996736:12345-192.168.201.1@tcp:101: 00010000:00010000:0.0:1787841664.254127:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841664.254149:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92cbc6725600/0xe3dac0c99affe267 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d66ca expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841664.254205:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92cbc6725600/0xe3dac0c99affe267 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d66ca expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841664.254218:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92cbc6725600/0xe3dac0c99affe267 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d66ca expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841664.254228:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc6725600, rc 0) 00000100:00100000:0.0:1787841664.254307:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a1f1ce-26b5-4cc6-a1db-8e09063432da+9:5593:x1874687694996736:12345-192.168.201.1@tcp:101: Request processed in 206us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841664.254316:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 121 00000100:00100000:1.0:1787841664.259444:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841664.259595:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687694996864 00000100:00100000:3.0:1787841664.259609:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687694996864 00000100:00100000:3.0:1787841664.259682:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 122 00000100:00100000:3.0:1787841664.259695:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a1f1ce-26b5-4cc6-a1db-8e09063432da+9:5593:x1874687694996864:12345-192.168.201.1@tcp:256: 20000000:01000000:3.0:1787841664.259778:0:5833:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1787841664.259814:0:5833:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787841664.259819:0:5833:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1787841664.259822:0:5833:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1787841664.259824:0:5833:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1787841664.263579:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a1f1ce-26b5-4cc6-a1db-8e09063432da+9:5593:x1874687694996864:12345-192.168.201.1@tcp:256: Request processed in 3866us (4141us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841664.263618:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 122 00000100:00100000:1.0:1787841664.268525:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841664.268743:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687694996992 00000100:00100000:0.0:1787841664.268759:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687694996992 00000100:00100000:0.0:1787841664.268837:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 123 00000100:00100000:0.0:1787841664.268850:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a1f1ce-26b5-4cc6-a1db-8e09063432da+9:5593:x1874687694996992:12345-192.168.201.1@tcp:101: 00010000:00010000:0.0:1787841664.268879:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841664.268908:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92cbc6725c00/0xe3dac0c99affe26e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d66d1 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841664.268955:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92cbc6725c00/0xe3dac0c99affe26e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d66d1 expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841664.268969:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92cbc6725c00/0xe3dac0c99affe26e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d66d1 expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841664.268992:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc6725c00, rc 0) 00000100:00100000:0.0:1787841664.269083:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a1f1ce-26b5-4cc6-a1db-8e09063432da+10:5593:x1874687694996992:12345-192.168.201.1@tcp:101: Request processed in 235us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841664.269092:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 123 00000100:00100000:1.0:1787841664.272247:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841664.272445:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687694997120 00000100:00100000:3.0:1787841664.272461:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687694997120 00000100:00100000:3.0:1787841664.272542:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 124 00000100:00100000:3.0:1787841664.272556:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a1f1ce-26b5-4cc6-a1db-8e09063432da+10:5593:x1874687694997120:12345-192.168.201.1@tcp:501: 00000100:00100000:3.0:1787841664.273251:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a1f1ce-26b5-4cc6-a1db-8e09063432da+10:5593:x1874687694997120:12345-192.168.201.1@tcp:501: Request processed in 693us (1016us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841664.273262:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 124 00000100:00100000:3.0:1787841664.276475:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841664.276757:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687694997248 00000100:00100000:2.0:1787841664.276772:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687694997248 00000100:00100000:2.0:1787841664.276844:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 125 00000100:00100000:2.0:1787841664.276855:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a1f1ce-26b5-4cc6-a1db-8e09063432da+10:5593:x1874687694997248:12345-192.168.201.1@tcp:503: 00000100:00100000:2.0:1787841664.277651:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a1f1ce-26b5-4cc6-a1db-8e09063432da+10:5593:x1874687694997248:12345-192.168.201.1@tcp:503: Request processed in 794us (1192us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841664.277662:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 125 00000100:00100000:1.0:1787841664.282331:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841664.282551:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687694997376 00000100:00100000:3.0:1787841664.282564:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687694997376 00000100:00100000:3.0:1787841664.282638:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 126 00000100:00100000:3.0:1787841664.282650:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a1f1ce-26b5-4cc6-a1db-8e09063432da+10:5617:x1874687694997376:12345-192.168.201.1@tcp:502: 00000100:00100000:3.0:1787841664.283064:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a1f1ce-26b5-4cc6-a1db-8e09063432da+10:5617:x1874687694997376:12345-192.168.201.1@tcp:502: Request processed in 414us (748us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841664.283073:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 126 00000100:00100000:3.0:1787841664.288897:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841664.289029:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687694997504 00000100:00100000:0.0:1787841664.289043:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687694997504 00000100:00100000:0.0:1787841664.289115:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 127 00000100:00100000:0.0:1787841664.289127:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a1f1ce-26b5-4cc6-a1db-8e09063432da+10:5617:x1874687694997504:12345-192.168.201.1@tcp:502: 00000100:00100000:0.0:1787841664.289770:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a1f1ce-26b5-4cc6-a1db-8e09063432da+10:5617:x1874687694997504:12345-192.168.201.1@tcp:502: Request processed in 641us (883us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841664.289780:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 127 00000100:00100000:1.0:1787841664.294342:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841664.294470:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687694997632 00000100:00100000:2.0:1787841664.294486:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687694997632 00000100:00100000:2.0:1787841664.294555:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 4 00000100:00100000:2.0:1787841664.294566:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf8dc8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2353:x1874687694997632:12345-192.168.201.1@tcp:38: 00010000:00080000:2.0:1787841664.294610:0:5839:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from b2767a54-6703-4908-8414-eab6601e2ceb@192.168.201.1@tcp t0 exp 0000000000000000 cur 204 last 0 00000020:00000080:2.0:1787841664.294680:0:5839:0:(genops.c:1385:class_connect()) connect: client b2767a54-6703-4908-8414-eab6601e2ceb, cookie 0xe3dac0c99affe275 00000004:00100000:2.0:1787841664.294770:0:5839:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1787841664.294778:0:5839:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:2.0:1787841664.324520:0:5839:0:(import.c:65:import_set_state_nolock()) ffff92cbf71af000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787841664.324667:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf8dc8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+6:2353:x1874687694997632:12345-192.168.201.1@tcp:38: Request processed in 30099us (30340us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841664.324742:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 4 00010000:00010000:0.0:1787841664.581838:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787841665.330899:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841665.330956:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841665.331379:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687694997760 00000100:00100000:2.0:1787841665.331393:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687694997760 00000100:00100000:2.0:1787841665.331480:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687694997888 00000100:00100000:2.0:1787841665.331484:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687694997888 00000100:00100000:2.0:1787841665.331506:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 5 00000100:00100000:2.0:1787841665.331519:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf8dc83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2767a54-6703-4908-8414-eab6601e2ceb+7:0:x1874687694997760:12345-192.168.201.1@tcp:41: 00000004:00000024:2.0:1787841665.331586:0:5838:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1787841665.331678:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf8dc83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2767a54-6703-4908-8414-eab6601e2ceb+7:0:x1874687694997760:12345-192.168.201.1@tcp:41: Request processed in 161us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841665.331686:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 5 00000100:00100000:2.0:1787841665.331738:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 6 00000100:00100000:2.0:1787841665.331745:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf8dca1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2767a54-6703-4908-8414-eab6601e2ceb+6:5593:x1874687694997888:12345-192.168.201.1@tcp:41: 00000004:00000024:2.0:1787841665.331756:0:5838:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1787841665.331776:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf8dca1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2767a54-6703-4908-8414-eab6601e2ceb+6:5593:x1874687694997888:12345-192.168.201.1@tcp:41: Request processed in 31us (820us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841665.331782:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 6 00000100:00080000:3.0:1787841665.331851:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787841665.336501:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841665.336673:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687694998016 00000100:00100000:2.0:1787841665.336688:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687694998016 00000100:00100000:2.0:1787841665.336816:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 7 00000100:00100000:2.0:1787841665.336828:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf8e82d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2767a54-6703-4908-8414-eab6601e2ceb+6:5593:x1874687694998016:12345-192.168.201.1@tcp:40: 00000100:00100000:2.0:1787841665.337117:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf8e82d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2767a54-6703-4908-8414-eab6601e2ceb+6:5593:x1874687694998016:12345-192.168.201.1@tcp:40: Request processed in 130us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841665.337127:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 7 00000100:00100000:1.0:1787841665.345988:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841665.348834:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841665.355935:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841665.355986:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841665.356190:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687694998400 00000100:00100000:1.0:1787841665.356205:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687694998400 00000100:00100000:1.0:1787841665.356268:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 0 00000100:00100000:1.0:1787841665.356280:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf8e83840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b2767a54-6703-4908-8414-eab6601e2ceb+6:5593:x1874687694998400:12345-192.168.201.1@tcp:33: 00000100:00100000:0.0:1787841665.359579:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687694998528 00000100:00100000:0.0:1787841665.359602:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687694998528 00000100:00100000:0.0:1787841665.359730:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 128 00000100:00100000:0.0:1787841665.359744:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe9a1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a1f1ce-26b5-4cc6-a1db-8e09063432da+10:2355:x1874687694998528:12345-192.168.201.1@tcp:400: 00000100:00100000:0.0:1787841665.359877:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe9a1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a1f1ce-26b5-4cc6-a1db-8e09063432da+10:2355:x1874687694998528:12345-192.168.201.1@tcp:400: Request processed in 135us (3889us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841665.359886:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 128 00000100:00100000:2.0:1787841665.371898:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687694998144 00000100:00100000:2.0:1787841665.371941:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687694998144 00000100:00100000:2.0:1787841665.372017:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687694998272 00000100:00100000:2.0:1787841665.372022:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687694998272 00000100:00100000:2.0:1787841665.373159:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 9 00000100:00100000:2.0:1787841665.373192:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff3ead00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2353:x1874687694998144:12345-192.168.201.1@tcp:8: 00010000:00080000:2.0:1787841665.373243:0:6686:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from b2767a54-6703-4908-8414-eab6601e2ceb@192.168.201.1@tcp t0 exp 0000000000000000 cur 205 last 0 00000020:00000080:2.0:1787841665.373285:0:6686:0:(genops.c:1385:class_connect()) connect: client b2767a54-6703-4908-8414-eab6601e2ceb, cookie 0xe3dac0c99affe27c 00002000:00100000:2.0:1787841665.373303:0:6686:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli b2767a54-6703-4908-8414-eab6601e2ceb/ffff92cbf71a8800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211395f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787841665.373337:0:6686:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787841665.373806:0:6686:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787841665.373855:0:6686:0:(import.c:65:import_set_state_nolock()) ffff92cbf71ad000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787841665.373968:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff3ead00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b2767a54-6703-4908-8414-eab6601e2ceb+6:2353:x1874687694998144:12345-192.168.201.1@tcp:8: Request processed in 780us (27998us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841665.383080:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 9 00000100:00100000:2.0:1787841665.383133:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 10 00000100:00100000:2.0:1787841665.383144:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf8e81a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2353:x1874687694998272:12345-192.168.201.1@tcp:8: 00010000:00080000:2.0:1787841665.383216:0:6686:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from b2767a54-6703-4908-8414-eab6601e2ceb@192.168.201.1@tcp t0 exp 0000000000000000 cur 205 last 0 00000020:00000080:2.0:1787841665.383260:0:6686:0:(genops.c:1385:class_connect()) connect: client b2767a54-6703-4908-8414-eab6601e2ceb, cookie 0xe3dac0c99affe283 00002000:00100000:2.0:1787841665.383277:0:6686:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli b2767a54-6703-4908-8414-eab6601e2ceb/ffff92cbf71ab000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211395f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787841665.383310:0:6686:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787841665.383782:0:6686:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787841665.383825:0:6686:0:(import.c:65:import_set_state_nolock()) ffff92cbf71a8000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787841665.383921:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf8e81a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b2767a54-6703-4908-8414-eab6601e2ceb+6:2353:x1874687694998272:12345-192.168.201.1@tcp:8: Request processed in 777us (35101us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841665.383931:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 10 00000004:00080000:0.0:1787841665.402867:0:5840:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 46480us 00000004:00200000:1.0:1787841665.446124:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:1.0:1787841665.446383:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf8e83840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b2767a54-6703-4908-8414-eab6601e2ceb+6:5593:x1874687694998400:12345-192.168.201.1@tcp:33: Request processed in 90096us (90454us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841665.446397:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 0 00010000:00010000:3.0:1787841665.601036:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787841665.762223:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841665.762648:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687694998656 00000100:00100000:1.0:1787841665.762663:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687694998656 00000100:00100000:1.0:1787841665.762799:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 8 00000100:00100000:1.0:1787841665.762812:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbd4bae580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+6:5634:x1874687694998656:12345-192.168.201.1@tcp:101: 00010000:00010000:1.0:1787841665.762841:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841665.769363:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169a400/0xe3dac0c99affe28a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d66fb expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841665.769498:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169a800/0xe3dac0c99affe291 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841665.769516:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169a800/0xe3dac0c99affe291 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841665.769536:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169a800/0xe3dac0c99affe291 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787841665.769874:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1787841665.769880:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787841665.769978:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169a800/0xe3dac0c99affe291 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841665.770017:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169a400/0xe3dac0c99affe28a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d66fb expref: 8 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841665.770039:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169a800/0xe3dac0c99affe291 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d66fb expref: 7 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841665.770049:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92cbd1fc7a00) 00010000:00010000:1.0:1787841665.770053:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787841665.770057:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc169a800, rc 0) 00000100:00100000:1.0:1787841665.770147:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbd4bae580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+7:5634:x1874687694998656:12345-192.168.201.1@tcp:101: Request processed in 7338us (7939us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841665.770158:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 8 00010000:00010000:0.0:1787841666.625609:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787841667.329062:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787841667.329106:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf07f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874687714943104:0@lo:13: 00000100:00100000:1.0:1787841667.329476:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841667.329638:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714943104 00000100:00100000:2.0:1787841667.329649:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714943104 00000100:00100000:2.0:1787841667.329756:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787841667.329768:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff3e92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874687714943104:12345-0@lo:13: 00002000:00000024:2.0:1787841667.329817:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787841667.329889:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff3e92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874687714943104:12345-0@lo:13: Request processed in 124us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841667.329898:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787841667.330358:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf8e80780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874687714943616:0@lo:400: 00000100:00100000:0.0:1787841667.330403:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841667.330428:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787841667.330434:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf8e81680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3300:1874687714943232:0@lo:400: 00000100:00100000:0.0:1787841667.330463:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841667.330485:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf8e82580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1874687714943744:0@lo:400: 00000100:00100000:0.0:1787841667.330510:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841667.330536:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf8e83c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1874687714943488:0@lo:400: 00000100:00100000:0.0:1787841667.330559:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841667.330575:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787841667.330579:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf8e821c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874687714943360:0@lo:400: 00000100:00100000:0.0:1787841667.330597:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841667.330618:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714943744 00000100:00100000:0.0:1787841667.330622:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714943744 00000100:00100000:0.0:1787841667.330650:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714943488 00000100:00100000:0.0:1787841667.330663:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714943488 00000100:00100000:0.0:1787841667.330677:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714943360 00000100:00100000:0.0:1787841667.330678:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714943360 00000100:00100000:0.0:1787841667.330692:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787841667.330717:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf8e82940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874687714943744:12345-0@lo:400: 00000100:00100000:0.0:1787841667.330757:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf8e82940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874687714943744:12345-0@lo:400: Request processed in 59us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841667.330764:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787841667.330776:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787841667.330780:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf8e830c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874687714943488:12345-0@lo:400: 00000100:00100000:0.0:1787841667.330808:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf8e830c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874687714943488:12345-0@lo:400: Request processed in 28us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841667.330813:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787841667.330823:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787841667.330828:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbc3dcc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874687714943360:12345-0@lo:400: 00000100:00100000:0.0:1787841667.330851:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbc3dcc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874687714943360:12345-0@lo:400: Request processed in 23us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841667.330856:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787841667.330894:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf8e821c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874687714943360:0@lo:400: 00000100:00100000:0.0:1787841667.330906:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf8e83c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1874687714943488:0@lo:400: 00000100:00100000:0.0:1787841667.330944:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf8e82580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1874687714943744:0@lo:400: 00000100:00080000:3.0:1787841667.331494:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787841667.331501:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787841667.331521:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714943616 00000100:00100000:3.0:1787841667.331527:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714943616 00000100:00100000:3.0:1787841667.331586:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787841667.331595:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf8e80b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1874687714943616:12345-0@lo:400: 00000100:00100000:3.0:1787841667.331664:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf8e80b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1874687714943616:12345-0@lo:400: Request processed in 71us (1262us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841667.331670:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1787841667.331730:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbf8e80780 x1874687714943616/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787841683 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787841667.331741:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf8e80780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874687714943616:0@lo:400: 00000100:00100000:3.0:1787841667.331766:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714943232 00000100:00100000:3.0:1787841667.331769:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714943232 00000100:00100000:3.0:1787841667.331794:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1787841667.331801:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe9a19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:3300:x1874687714943232:12345-0@lo:400: 00000100:00100000:3.0:1787841667.331838:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe9a19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:3300:x1874687714943232:12345-0@lo:400: Request processed in 38us (1374us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841667.331844:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1787841667.331895:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf8e81680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3300:1874687714943232:0@lo:400: 00000100:00080000:2.0:1787841667.331970:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787841667.332067:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbf07f8000 x1874687714943104/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841683 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787841667.332078:0:3301:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1787841667.332099:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf07f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874687714943104:0@lo:13: 00010000:00010000:3.0:1787841667.650043:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787841668.107769:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841668.107879:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687694998784 00000100:00100000:0.0:1787841668.107895:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687694998784 00000100:00100000:0.0:1787841668.107996:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 9 00000100:00100000:0.0:1787841668.108008:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff3ebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+7:5686:x1874687694998784:12345-192.168.201.1@tcp:41: 00000004:00000024:0.0:1787841668.108082:0:5837:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1787841668.108234:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff3ebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+7:5686:x1874687694998784:12345-192.168.201.1@tcp:41: Request processed in 228us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841668.108242:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 9 00000100:00080000:2.0:1787841668.108450:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787841668.117097:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841668.117303:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687694998912 00000100:00100000:2.0:1787841668.117337:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687694998912 00000100:00100000:2.0:1787841668.117535:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 10 00000100:00100000:2.0:1787841668.117549:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbc3dcfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b2767a54-6703-4908-8414-eab6601e2ceb+6:5686:x1874687694998912:12345-192.168.201.1@tcp:13: 00002000:00000024:2.0:1787841668.117627:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787841668.117754:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbc3dcfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b2767a54-6703-4908-8414-eab6601e2ceb+6:5686:x1874687694998912:12345-192.168.201.1@tcp:13: Request processed in 209us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841668.117763:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 10 00000100:00080000:3.0:1787841668.121330:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787841668.124742:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841668.131816:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687694999040 00000100:00100000:2.0:1787841668.131840:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687694999040 00000100:00100000:2.0:1787841668.131965:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 11 00000100:00100000:2.0:1787841668.131978:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbd4bae1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b2767a54-6703-4908-8414-eab6601e2ceb+6:5686:x1874687694999040:12345-192.168.201.1@tcp:13: 00002000:00000024:2.0:1787841668.132015:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787841668.132454:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbd4bae1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b2767a54-6703-4908-8414-eab6601e2ceb+6:5686:x1874687694999040:12345-192.168.201.1@tcp:13: Request processed in 476us (7760us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841668.132465:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 11 00000100:00080000:3.0:1787841668.141455:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787841668.353092:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf07fb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687714943872:0@lo:13: 00000100:00100000:3.0:1787841668.353239:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841668.355349:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714943872 00000100:00100000:2.0:1787841668.355391:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714943872 00000100:00100000:2.0:1787841668.355486:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787841668.355499:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbd4bad2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874687714943872:12345-0@lo:13: 00002000:00000024:2.0:1787841668.355539:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787841668.355672:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbd4bad2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874687714943872:12345-0@lo:13: Request processed in 176us (2434us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841668.355681:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1787841668.355938:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbf07fb840 x1874687714943872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841684 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787841668.355976:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf07fb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687714943872:0@lo:13: 00010000:00010000:0.0:1787841668.678982:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787841669.010864:0:7643:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b2767a54-6703-4908-8414-eab6601e2ceb 00000001:00100000:1.0:1787841669.446208:0:5860:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of b2767a54-6703-4908-8414-eab6601e2ceb 00010000:00010000:2.0:1787841669.698181:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787841670.497749:0:6717:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b2767a54-6703-4908-8414-eab6601e2ceb 00010000:00010000:1.0:1787841670.721015:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787841670.815178:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841670.815233:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841670.815267:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841670.815299:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841670.815339:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687694999424 00000100:00100000:0.0:1787841670.815354:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687694999424 00000100:00100000:0.0:1787841670.815430:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687694999552 00000100:00100000:0.0:1787841670.815434:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687694999552 00000100:00100000:0.0:1787841670.815455:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 7 00000100:00100000:0.0:1787841670.815467:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbc3dcf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b2767a54-6703-4908-8414-eab6601e2ceb+5:2356:x1874687694999424:12345-192.168.201.1@tcp:400: 00000100:00100000:0.0:1787841670.815568:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbc3dcf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b2767a54-6703-4908-8414-eab6601e2ceb+5:2356:x1874687694999424:12345-192.168.201.1@tcp:400: Request processed in 102us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841670.815578:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 7 00000100:00100000:0.0:1787841670.815598:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 8 00000100:00100000:0.0:1787841670.815605:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbc3dcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b2767a54-6703-4908-8414-eab6601e2ceb+5:2356:x1874687694999552:12345-192.168.201.1@tcp:400: 00000100:00100000:0.0:1787841670.815632:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbc3dcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b2767a54-6703-4908-8414-eab6601e2ceb+5:2356:x1874687694999552:12345-192.168.201.1@tcp:400: Request processed in 27us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841670.815638:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 8 00000100:00080000:0.0:1787841670.815660:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787841670.815665:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787841670.815978:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687694999168 00000100:00100000:2.0:1787841670.815983:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687694999168 00000100:00100000:2.0:1787841670.816019:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 130 00000100:00100000:2.0:1787841670.816027:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe9a1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a1f1ce-26b5-4cc6-a1db-8e09063432da+10:2356:x1874687694999168:12345-192.168.201.1@tcp:400: 00000100:00100000:2.0:1787841670.816060:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe9a1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a1f1ce-26b5-4cc6-a1db-8e09063432da+10:2356:x1874687694999168:12345-192.168.201.1@tcp:400: Request processed in 34us (895us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841670.816067:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 130 00000100:00100000:1.0:1787841670.816511:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687694999296 00000100:00100000:1.0:1787841670.816516:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687694999296 00000100:00100000:1.0:1787841670.816580:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 23 00000100:00100000:1.0:1787841670.816589:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbc3dccf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+6:2356:x1874687694999296:12345-192.168.201.1@tcp:400: 00000100:00100000:1.0:1787841670.816635:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbc3dccf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+6:2356:x1874687694999296:12345-192.168.201.1@tcp:400: Request processed in 48us (1367us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841670.816642:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 23 00000100:00080000:0.0:1787841670.820138:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:0.0:1787841671.206039:0:8297:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1787841671.744965:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787841672.449238:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787841672.449281:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff3e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687714944000:0@lo:13: 00000100:00100000:1.0:1787841672.449841:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841672.450079:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714944000 00000100:00100000:3.0:1787841672.450090:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714944000 00000100:00100000:3.0:1787841672.450181:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787841672.450190:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff3e9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874687714944000:12345-0@lo:13: 00002000:00000024:3.0:1787841672.450241:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787841672.450301:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff3e9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874687714944000:12345-0@lo:13: Request processed in 112us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841672.450310:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1787841672.450973:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787841672.451020:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbff3e9680 x1874687714944000/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841688 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787841672.451047:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff3e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687714944000:0@lo:13: 00000100:00100000:2.0:1787841672.455776:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf07f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874687714944512:0@lo:400: 00000100:00100000:2.0:1787841672.455899:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841672.455929:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf07fa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3300:1874687714944128:0@lo:400: 00000100:00100000:1.0:1787841672.455976:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841672.458781:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf07f9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1874687714944640:0@lo:400: 00000100:00100000:1.0:1787841672.458878:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841672.458926:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787841672.458934:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf07f8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874687714944256:0@lo:400: 00000100:00100000:1.0:1787841672.458959:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841672.459011:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714944128 00000100:00100000:1.0:1787841672.459020:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714944128 00000100:00100000:1.0:1787841672.459101:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1787841672.459111:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe9a1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:3300:x1874687714944128:12345-0@lo:400: 00000100:00100000:1.0:1787841672.459172:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe9a1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:3300:x1874687714944128:12345-0@lo:400: Request processed in 62us (3195us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841672.459180:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1787841672.459217:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714944640 00000100:00100000:1.0:1787841672.459220:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714944640 00000100:00100000:1.0:1787841672.459257:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714944256 00000100:00100000:1.0:1787841672.459261:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714944256 00000100:00100000:1.0:1787841672.459276:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787841672.459282:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff3e9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874687714944640:12345-0@lo:400: 00000100:00100000:1.0:1787841672.459316:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff3e9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874687714944640:12345-0@lo:400: Request processed in 34us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841672.459323:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787841672.459336:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787841672.459342:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff3ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874687714944256:12345-0@lo:400: 00000100:00100000:1.0:1787841672.459369:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff3ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874687714944256:12345-0@lo:400: Request processed in 28us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841672.459375:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1787841672.459404:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787841672.460727:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf07fb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1874687714944384:0@lo:400: 00000100:00100000:1.0:1787841672.460788:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841672.460838:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714944384 00000100:00100000:1.0:1787841672.460843:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714944384 00000100:00100000:1.0:1787841672.460890:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787841672.460898:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff3e8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1874687714944384:12345-0@lo:400: 00000100:00100000:1.0:1787841672.460944:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff3e8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1874687714944384:12345-0@lo:400: Request processed in 46us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841672.460950:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:1.0:1787841672.460973:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787841672.461018:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf07fb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1874687714944384:0@lo:400: 00000100:00100000:1.0:1787841672.461056:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf07f8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874687714944256:0@lo:400: 00000100:00100000:1.0:1787841672.461079:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf07fa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3300:1874687714944128:0@lo:400: 00000100:00100000:1.0:1787841672.461093:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf07f9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1874687714944640:0@lo:400: 00000100:00100000:3.0:1787841672.461762:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714944512 00000100:00100000:3.0:1787841672.461772:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714944512 00000100:00100000:3.0:1787841672.461818:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787841672.461828:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf07fa580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1874687714944512:12345-0@lo:400: 00000100:00100000:3.0:1787841672.461878:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf07fa580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1874687714944512:12345-0@lo:400: Request processed in 53us (5980us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841672.461885:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1787841672.462670:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787841672.462851:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbf07f8000 x1874687714944512/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787841688 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787841672.462869:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf07f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874687714944512:0@lo:400: 00010000:00010000:1.0:1787841672.770073:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787841673.473341:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4bacf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874687714944768:0@lo:13: 00000100:00100000:1.0:1787841673.473450:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841673.473595:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714944768 00000100:00100000:0.0:1787841673.473605:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714944768 00000100:00100000:0.0:1787841673.473668:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787841673.473679:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff3e9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874687714944768:12345-0@lo:13: 00002000:00000024:0.0:1787841673.473749:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787841673.473819:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff3e9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874687714944768:12345-0@lo:13: Request processed in 142us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841673.473828:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1787841673.473953:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbd4bacf00 x1874687714944768/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841689 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787841673.473977:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4bacf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874687714944768:0@lo:13: 00010000:00010000:2.0:1787841673.793469:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841674.821773:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787841674.893080:0:8445:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffeea0901c0 20000000:00000080:3.0:1787841674.893096:0:8445:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff92cbc9516c00 uarg=0000000000000000 20000000:01000000:3.0:1787841674.893131:0:8445:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1787841674.893133:0:8445:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1787841674.893136:0:8445:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1787841674.893140:0:8445:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1787841674.893145:0:8445:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1787841674.893158:0:8445:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787841674.893160:0:8445:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1787841674.897431:0:8445:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1787841674.897440:0:8445:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787841674.900419:0:8446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:0.0:1787841674.902314:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:0.0:1787841674.902422:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:0.0:1787841674.902465:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:0.0:1787841674.902487:0:8445:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1787841674.902491:0:8445:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787841674.903402:0:8447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:1.0:1787841674.903876:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:1.0:1787841674.903928:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:1.0:1787841674.903984:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:1.0:1787841674.904000:0:8445:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787841674.904003:0:8445:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787841674.906020:0:8448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:3.0:1787841674.906623:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:3.0:1787841674.906676:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:3.0:1787841674.906879:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:3.0:1787841674.906894:0:8445:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1787841674.906897:0:8445:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787841674.909734:0:8449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:1.0:1787841674.910270:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:1.0:1787841674.910339:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:1.0:1787841674.910378:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:1.0:1787841674.910405:0:8445:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1787841674.910427:0:8445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff92cbc169a600/0xe3dac0c99affe298 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841674.910448:0:8445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92cbc169b400/0xe3dac0c99affe195 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe3dac0c99affe18e expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841674.910456:0:8445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92cbc169b800/0xe3dac0c99affe1bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe3dac0c99affe1b8 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841674.910463:0:8445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92cbc149c200/0xe3dac0c99affe1e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe3dac0c99affe1e2 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841674.910470:0:8445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92cbc6725000/0xe3dac0c99affe1f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe3dac0c99affe1f0 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841674.910476:0:8445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92cbc6725a00/0xe3dac0c99affe205 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe3dac0c99affe1fe expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841674.910483:0:8445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92cbc6724800/0xe3dac0c99affe221 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe3dac0c99affe21a expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841674.910490:0:8445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92cbc6598000/0xe3dac0c99affe24b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe3dac0c99affe244 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841674.910499:0:8445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92cbc6598800/0xe3dac0c99affe259 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6699 expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841674.910507:0:8445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92cbc149c600/0xe3dac0c99affe260 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d66a0 expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841674.910515:0:8445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff92cbc169a600/0xe3dac0c99affe298 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841674.910562:0:8445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92cbc149c600/0xe3dac0c99affe260 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d66a0 expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841674.910578:0:8445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92cbc149c600/0xe3dac0c99affe260 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d66a0 expref: 9 pid: 5833 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841674.910594:0:8445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff3e8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1874687714944896:192.168.201.1@tcp:104: 00010000:00010000:1.0:1787841674.910996:0:8445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92cbc6598800/0xe3dac0c99affe259 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6699 expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841674.911007:0:8445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92cbc6598800/0xe3dac0c99affe259 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6699 expref: 9 pid: 5831 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841674.911017:0:8445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff3eb0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1874687714945024:192.168.201.1@tcp:104: 00010000:00010000:1.0:1787841674.911115:0:8445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92cbc6598000/0xe3dac0c99affe24b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe3dac0c99affe244 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841674.911125:0:8445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92cbc6598000/0xe3dac0c99affe24b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe3dac0c99affe244 expref: 18 pid: 5831 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841674.911134:0:8445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff3ea940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1874687714945152:0@lo:104: 00000100:00100000:1.0:1787841674.911172:0:8445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787841674.911204:0:8445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92cbc6724800/0xe3dac0c99affe221 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe3dac0c99affe21a expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841674.911212:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714945152 00010000:00010000:1.0:1787841674.911214:0:8445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92cbc6724800/0xe3dac0c99affe221 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe3dac0c99affe21a expref: 18 pid: 5832 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841674.911220:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714945152 00000100:00100000:1.0:1787841674.911238:0:8445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff3ea580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1874687714945280:0@lo:104: 00000100:00100000:1.0:1787841674.911265:0:8445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841674.911270:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787841674.911279:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff3e8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+3:8445:x1874687714945152:12345-0@lo:104: 00010000:00010000:1.0:1787841674.911285:0:8445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92cbc6725a00/0xe3dac0c99affe205 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe3dac0c99affe1fe expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841674.911297:0:8445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92cbc6725a00/0xe3dac0c99affe205 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe3dac0c99affe1fe expref: 18 pid: 5833 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841674.911298:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.101@tcp lock: ffff92cbc6599600/0xe3dac0c99affe244 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xe3dac0c99affe24b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841674.911318:0:8445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff3e83c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1874687714945408:0@lo:104: 00010000:00010000:1.0:1787841674.911351:0:8445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92cbc6725000/0xe3dac0c99affe1f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe3dac0c99affe1f0 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841674.911358:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:1.0:1787841674.911361:0:8445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92cbc6725000/0xe3dac0c99affe1f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe3dac0c99affe1f0 expref: 18 pid: 5832 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841674.911366:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff3e8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+3:8445:x1874687714945152:12345-0@lo:104: Request processed in 87us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841674.911378:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787841674.911380:0:8445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff3eb840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1874687714945536:0@lo:104: 00000100:00100000:2.0:1787841674.911402:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:1.0:1787841674.911411:0:8445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92cbc149c200/0xe3dac0c99affe1e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe3dac0c99affe1e2 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841674.911420:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787841674.911424:0:8445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92cbc149c200/0xe3dac0c99affe1e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe3dac0c99affe1e2 expref: 18 pid: 5831 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841674.911433:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841674.911441:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714945280 00000100:00100000:1.0:1787841674.911441:0:8445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff3e8780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1874687714945664:0@lo:104: 00000100:00100000:2.0:1787841674.911446:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714945280 00000100:00100000:2.0:1787841674.911467:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714945408 00000100:00100000:2.0:1787841674.911470:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714945408 00000100:00100000:1.0:1787841674.911471:0:8445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841674.911486:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714945536 00000100:00100000:2.0:1787841674.911490:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714945536 00000100:00100000:2.0:1787841674.911500:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714945664 00000100:00100000:2.0:1787841674.911503:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714945664 00010000:00010000:1.0:1787841674.911508:0:8445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92cbc169b800/0xe3dac0c99affe1bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe3dac0c99affe1b8 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841674.911519:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00010000:00010000:1.0:1787841674.911521:0:8445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92cbc169b800/0xe3dac0c99affe1bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe3dac0c99affe1b8 expref: 18 pid: 5833 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841674.911525:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf71b7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+6:8445:x1874687714945280:12345-0@lo:104: 00010000:00010000:2.0:1787841674.911535:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.101@tcp lock: ffff92cbc6724c00/0xe3dac0c99affe21a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xe3dac0c99affe221 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841674.911543:0:8445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e643c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1874687714945792:0@lo:104: 00010000:00010000:2.0:1787841674.911574:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787841674.911579:0:8445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841674.911583:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf71b7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+6:8445:x1874687714945280:12345-0@lo:104: Request processed in 56us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841674.911589:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:1.0:1787841674.911607:0:8445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92cbc169b400/0xe3dac0c99affe195 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe3dac0c99affe18e expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841674.911614:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714945792 00000100:00100000:2.0:1787841674.911618:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714945792 00010000:00010000:1.0:1787841674.911618:0:8445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92cbc169b400/0xe3dac0c99affe195 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe3dac0c99affe18e expref: 18 pid: 5831 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841674.911632:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787841674.911632:0:8445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e652c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1874687714945920:0@lo:104: 00000100:00100000:2.0:1787841674.911644:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf07f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+6:8445:x1874687714945408:12345-0@lo:104: 00010000:00010000:2.0:1787841674.911651:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.101@tcp lock: ffff92cbc6725800/0xe3dac0c99affe1fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xe3dac0c99affe205 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841674.911659:0:8445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841674.911674:0:8445:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbe771db40 going to sleep for 11 seconds 00010000:00010000:2.0:1787841674.911683:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787841674.911688:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf07f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+6:8445:x1874687714945408:12345-0@lo:104: Request processed in 45us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841674.911694:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787841674.911728:0:8445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff3ea940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1874687714945152:0@lo:104: 00000100:00100000:2.0:1787841674.911732:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714945920 00000100:00100000:2.0:1787841674.911737:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714945920 00000100:00100000:1.0:1787841674.911743:0:8445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff3ea580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1874687714945280:0@lo:104: 00000100:00100000:2.0:1787841674.911756:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787841674.911758:0:8445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff3e83c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1874687714945408:0@lo:104: 00000100:00100000:2.0:1787841674.911764:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf07f8780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+6:8445:x1874687714945536:12345-0@lo:104: 00010000:00010000:2.0:1787841674.911770:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.101@tcp lock: ffff92cbc169be00/0xe3dac0c99affe1f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xe3dac0c99affe1f7 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841674.911806:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1787841674.911810:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf07f8780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+6:8445:x1874687714945536:12345-0@lo:104: Request processed in 48us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841674.911814:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787841674.911824:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787841674.911831:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf8dca580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+5:8445:x1874687714945664:12345-0@lo:104: 00010000:00010000:2.0:1787841674.911839:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.101@tcp lock: ffff92cbc6724a00/0xe3dac0c99affe1e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xe3dac0c99affe1e9 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841674.911865:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1787841674.911870:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf8dca580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+5:8445:x1874687714945664:12345-0@lo:104: Request processed in 41us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841674.911876:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787841674.911892:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787841674.911896:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e66d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+4:8445:x1874687714945792:12345-0@lo:104: 00010000:00010000:2.0:1787841674.911902:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.101@tcp lock: ffff92cbc169ba00/0xe3dac0c99affe1b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xe3dac0c99affe1bf expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841674.911928:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:2.0:1787841674.911933:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e66d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+4:8445:x1874687714945792:12345-0@lo:104: Request processed in 36us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841674.911938:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787841674.911949:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787841674.911955:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e67c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+3:8445:x1874687714945920:12345-0@lo:104: 00010000:00010000:2.0:1787841674.911962:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.101@tcp lock: ffff92cbc169a200/0xe3dac0c99affe18e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xe3dac0c99affe195 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841674.911985:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:2.0:1787841674.911989:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e67c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+3:8445:x1874687714945920:12345-0@lo:104: Request processed in 36us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841674.911995:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1787841674.912014:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1787841674.912020:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.101@tcp lock: ffff92cbc6599600/0xe3dac0c99affe244 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xe3dac0c99affe24b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841674.912039:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6599600 already unused, calling callback (ffffffffc1d9fc20) 10000000:00010000:2.0:1787841674.912044:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.101@tcp lock: ffff92cbc6599600/0xe3dac0c99affe244 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xe3dac0c99affe24b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841674.912053:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.101@tcp lock: ffff92cbc6599600/0xe3dac0c99affe244 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xe3dac0c99affe24b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787841674.912070:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.101@tcp lock: ffff92cbc6599600/0xe3dac0c99affe244 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xe3dac0c99affe24b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787841674.912076:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1787841674.912107:0:8445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff3eb840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1874687714945536:0@lo:104: 00010000:00010000:2.0:1787841674.912114:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.101@tcp lock: ffff92cbc6599600/0xe3dac0c99affe244 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99affe24b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841674.912118:0:8445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff3e8780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1874687714945664:0@lo:104: 00010000:00010000:2.0:1787841674.912128:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787841674.912131:0:8445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e643c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1874687714945792:0@lo:104: 00000100:00100000:1.0:1787841674.912142:0:8445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e652c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1874687714945920:0@lo:104: 00010000:00010000:2.0:1787841674.912152:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.101@tcp lock: ffff92cbc6599600/0xe3dac0c99affe244 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99affe24b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841674.912161:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.101@tcp lock: ffff92cbc6599600/0xe3dac0c99affe244 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99affe24b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841674.912176:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1787841674.912179:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.101@tcp lock: ffff92cbc6724c00/0xe3dac0c99affe21a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xe3dac0c99affe221 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841674.912185:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6724c00 already unused, calling callback (ffffffffc1d9fc20) 10000000:00010000:2.0:1787841674.912189:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.101@tcp lock: ffff92cbc6724c00/0xe3dac0c99affe21a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xe3dac0c99affe221 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841674.912196:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.101@tcp lock: ffff92cbc6724c00/0xe3dac0c99affe21a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xe3dac0c99affe221 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787841674.912202:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.101@tcp lock: ffff92cbc6724c00/0xe3dac0c99affe21a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xe3dac0c99affe221 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787841674.912207:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787841674.912242:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.101@tcp lock: ffff92cbc6724c00/0xe3dac0c99affe21a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99affe221 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841674.912248:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787841674.912254:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.101@tcp lock: ffff92cbc6724c00/0xe3dac0c99affe21a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99affe221 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841674.912260:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.101@tcp lock: ffff92cbc6724c00/0xe3dac0c99affe21a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99affe221 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841674.912272:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1787841674.912275:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.101@tcp lock: ffff92cbc6725800/0xe3dac0c99affe1fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xe3dac0c99affe205 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841674.912281:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6725800 already unused, calling callback (ffffffffc1d9fc20) 10000000:00010000:2.0:1787841674.912284:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.101@tcp lock: ffff92cbc6725800/0xe3dac0c99affe1fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xe3dac0c99affe205 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841674.912292:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.101@tcp lock: ffff92cbc6725800/0xe3dac0c99affe1fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xe3dac0c99affe205 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787841674.912298:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.101@tcp lock: ffff92cbc6725800/0xe3dac0c99affe1fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xe3dac0c99affe205 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787841674.912303:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787841674.912329:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.101@tcp lock: ffff92cbc6725800/0xe3dac0c99affe1fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99affe205 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841674.912335:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787841674.912358:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.101@tcp lock: ffff92cbc6725800/0xe3dac0c99affe1fe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99affe205 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841674.912376:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.101@tcp lock: ffff92cbc6725800/0xe3dac0c99affe1fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99affe205 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841674.912383:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:2.0:1787841674.912387:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1787841674.912392:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.101@tcp lock: ffff92cbc169be00/0xe3dac0c99affe1f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe3dac0c99affe1f7 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841674.912399:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf07f8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3301:1874687714946304:0@lo:103: 00010000:00010000:2.0:1787841674.912401:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc169be00 already unused, calling callback (ffffffffc1d9fc20) 10000000:00010000:2.0:1787841674.912408:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.101@tcp lock: ffff92cbc169be00/0xe3dac0c99affe1f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xe3dac0c99affe1f7 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841674.912415:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.101@tcp lock: ffff92cbc169be00/0xe3dac0c99affe1f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xe3dac0c99affe1f7 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787841674.912421:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.101@tcp lock: ffff92cbc169be00/0xe3dac0c99affe1f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xe3dac0c99affe1f7 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787841674.912426:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1787841674.912437:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787841674.912457:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.101@tcp lock: ffff92cbc169be00/0xe3dac0c99affe1f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99affe1f7 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841674.912465:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787841674.912474:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.101@tcp lock: ffff92cbc169be00/0xe3dac0c99affe1f0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99affe1f7 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841674.912480:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.101@tcp lock: ffff92cbc169be00/0xe3dac0c99affe1f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99affe1f7 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841674.912482:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714946304 00000100:00100000:3.0:1787841674.912488:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714946304 00010000:00010000:2.0:1787841674.912493:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787841674.912502:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.101@tcp lock: ffff92cbc6724a00/0xe3dac0c99affe1e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe3dac0c99affe1e9 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841674.912509:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6724a00 already unused, calling callback (ffffffffc1d9fc20) 00010000:00010000:3.0:1787841674.912513:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92cbc6725a00/0xe3dac0c99affe205 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe3dac0c99affe1fe expref: 19 pid: 5833 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787841674.912514:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.101@tcp lock: ffff92cbc6724a00/0xe3dac0c99affe1e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xe3dac0c99affe1e9 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841674.912535:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.101@tcp lock: ffff92cbc6724a00/0xe3dac0c99affe1e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xe3dac0c99affe1e9 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787841674.912541:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.101@tcp lock: ffff92cbc6724a00/0xe3dac0c99affe1e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xe3dac0c99affe1e9 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787841674.912547:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1787841674.912551:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787841674.912561:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbd4bacf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:3301:x1874687714946304:12345-0@lo:103: 00010000:00010000:2.0:1787841674.912566:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.101@tcp lock: ffff92cbc6724a00/0xe3dac0c99affe1e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99affe1e9 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841674.912572:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787841674.912574:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787841674.912580:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92cbc6725a00/0xe3dac0c99affe205 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe3dac0c99affe1fe expref: 19 pid: 5833 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841674.912581:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.101@tcp lock: ffff92cbc6724a00/0xe3dac0c99affe1e2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99affe1e9 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841674.912599:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.101@tcp lock: ffff92cbc6724a00/0xe3dac0c99affe1e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99affe1e9 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841674.912602:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92cbc6725a00/0xe3dac0c99affe205 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe3dac0c99affe1fe expref: 19 pid: 5833 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841674.912617:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787841674.912621:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.101@tcp lock: ffff92cbc169ba00/0xe3dac0c99affe1b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe3dac0c99affe1bf expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841674.912625:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92cbc6725a00/0xe3dac0c99affe205 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe3dac0c99affe1fe expref: 19 pid: 5833 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841674.912635:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc169ba00 already unused, calling callback (ffffffffc1d9fc20) 10000000:00010000:2.0:1787841674.912640:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.101@tcp lock: ffff92cbc169ba00/0xe3dac0c99affe1b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe3dac0c99affe1bf expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841674.912646:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787841674.912659:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.101@tcp lock: ffff92cbc169ba00/0xe3dac0c99affe1b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe3dac0c99affe1bf expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787841674.912666:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.101@tcp lock: ffff92cbc169ba00/0xe3dac0c99affe1b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe3dac0c99affe1bf expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787841674.912672:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787841674.912686:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.101@tcp lock: ffff92cbc169ba00/0xe3dac0c99affe1b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99affe1bf expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841674.912692:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787841674.912720:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.101@tcp lock: ffff92cbc169ba00/0xe3dac0c99affe1b8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99affe1bf expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841674.912727:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.101@tcp lock: ffff92cbc169ba00/0xe3dac0c99affe1b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99affe1bf expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841674.912739:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787841674.912742:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.101@tcp lock: ffff92cbc169a200/0xe3dac0c99affe18e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe3dac0c99affe195 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841674.912749:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc169a200 already unused, calling callback (ffffffffc1d9fc20) 10000000:00010000:2.0:1787841674.912752:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.101@tcp lock: ffff92cbc169a200/0xe3dac0c99affe18e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe3dac0c99affe195 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841674.912759:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.101@tcp lock: ffff92cbc169a200/0xe3dac0c99affe18e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe3dac0c99affe195 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787841674.912765:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.101@tcp lock: ffff92cbc169a200/0xe3dac0c99affe18e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe3dac0c99affe195 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787841674.912776:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787841674.912792:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.101@tcp lock: ffff92cbc169a200/0xe3dac0c99affe18e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99affe195 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841674.912798:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787841674.912804:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.101@tcp lock: ffff92cbc169a200/0xe3dac0c99affe18e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99affe195 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841674.912809:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.101@tcp lock: ffff92cbc169a200/0xe3dac0c99affe18e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99affe195 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841674.912822:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841674.912824:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841674.912826:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841674.912833:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787841674.912844:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf07f9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3298:1874687714946048:0@lo:103: 00000100:00100000:3.0:1787841674.912979:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbd4bacf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+18:3301:x1874687714946304:12345-0@lo:103: Request processed in 418us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841674.912988:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787841674.912991:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841674.913014:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714946048 00000100:00100000:2.0:1787841674.913017:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf8dc8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3298:1874687714946560:0@lo:103: 00000100:00100000:3.0:1787841674.913019:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714946048 00010000:00010000:3.0:1787841674.913054:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92cbc6598000/0xe3dac0c99affe24b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe3dac0c99affe244 expref: 18 pid: 5831 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841674.913064:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841674.913093:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787841674.913099:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf07fa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3298:1874687714946176:0@lo:103: 00000100:00100000:2.0:1787841674.913122:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841674.913224:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf8dcb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3300:1874687714946816:0@lo:103: 00000100:00100000:3.0:1787841674.913279:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714946560 00000100:00100000:3.0:1787841674.913285:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714946560 00000100:00100000:2.0:1787841674.913303:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf8dcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3298:1874687714946688:0@lo:103: 00010000:00010000:3.0:1787841674.913305:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92cbc149c200/0xe3dac0c99affe1e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe3dac0c99affe1e2 expref: 19 pid: 5831 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841674.913326:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714946176 00000100:00100000:3.0:1787841674.913329:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714946176 00000100:00100000:2.0:1787841674.913334:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787841674.913345:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92cbc6724800/0xe3dac0c99affe221 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe3dac0c99affe21a expref: 20 pid: 5832 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841674.913360:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714946688 00000100:00100000:3.0:1787841674.913363:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714946688 00000100:00100000:2.0:1787841674.913369:0:7633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00010000:00010000:3.0:1787841674.913376:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92cbc169b800/0xe3dac0c99affe1bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe3dac0c99affe1b8 expref: 21 pid: 5833 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841674.913383:0:7633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf8dc92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f6e7591a-84a0-4774-9d28-b3ed28591dc5+21:3298:x1874687714946048:12345-0@lo:103: 00010000:00010000:2.0:1787841674.913396:0:7633:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1787841674.913397:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787841674.913407:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff3e8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+21:3298:x1874687714946560:12345-0@lo:103: 00010000:00010000:2.0:1787841674.913411:0:7633:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92cbc6598000/0xe3dac0c99affe24b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe3dac0c99affe244 expref: 21 pid: 5831 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841674.913418:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787841674.913423:0:7633:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92cbc6598000/0xe3dac0c99affe24b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe3dac0c99affe244 expref: 21 pid: 5831 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841674.913425:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92cbc149c200/0xe3dac0c99affe1e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe3dac0c99affe1e2 expref: 21 pid: 5831 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841674.913447:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92cbc6598000/0xe3dac0c99affe24b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe3dac0c99affe244 expref: 21 pid: 5831 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841674.913456:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92cbc149c200/0xe3dac0c99affe1e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe3dac0c99affe1e2 expref: 20 pid: 5831 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841674.913465:0:7633:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787841674.913472:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92cbc149c200/0xe3dac0c99affe1e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe3dac0c99affe1e2 expref: 20 pid: 5831 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841674.913495:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787841674.913516:0:7633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf8dc92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:3298:x1874687714946048:12345-0@lo:103: Request processed in 139us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841674.913524:0:7633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787841674.913540:0:7633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787841674.913546:0:7633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbd4a9cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f6e7591a-84a0-4774-9d28-b3ed28591dc5+18:3298:x1874687714946176:12345-0@lo:103: 00010000:00010000:2.0:1787841674.913553:0:7633:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787841674.913557:0:7633:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92cbc6724800/0xe3dac0c99affe221 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe3dac0c99affe21a expref: 18 pid: 5832 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841674.913565:0:7633:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92cbc6724800/0xe3dac0c99affe221 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe3dac0c99affe21a expref: 18 pid: 5832 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841674.913574:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92cbc6724800/0xe3dac0c99affe221 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe3dac0c99affe21a expref: 18 pid: 5832 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841674.913582:0:7633:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787841674.913622:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff3e8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+17:3298:x1874687714946560:12345-0@lo:103: Request processed in 215us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841674.913623:0:7633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbd4a9cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f6e7591a-84a0-4774-9d28-b3ed28591dc5+17:3298:x1874687714946176:12345-0@lo:103: Request processed in 75us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841674.913638:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787841674.913645:0:7633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787841674.913659:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787841674.913668:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbd4a9f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+15:3298:x1874687714946688:12345-0@lo:103: 00010000:00010000:3.0:1787841674.913679:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787841674.913684:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92cbc169b800/0xe3dac0c99affe1bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe3dac0c99affe1b8 expref: 15 pid: 5833 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841674.913750:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf07fa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3298:1874687714946176:0@lo:103: 00000100:00100000:1.0:1787841674.913763:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf07f9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3298:1874687714946048:0@lo:103: 00000100:00100000:1.0:1787841674.913770:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf8dc8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3298:1874687714946560:0@lo:103: 00000100:00100000:2.0:1787841674.913803:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf07fb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3301:1874687714946432:0@lo:103: 00000100:00100000:2.0:1787841674.913838:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841674.913877:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf07f8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3301:1874687714946304:0@lo:103: 00000100:00100000:2.0:1787841674.913907:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714946432 00000100:00100000:2.0:1787841674.913911:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714946432 00010000:00010000:2.0:1787841674.913927:0:7632:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92cbc6725000/0xe3dac0c99affe1f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe3dac0c99affe1f0 expref: 16 pid: 5832 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841674.913959:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787841674.913965:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbd4a9e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f6e7591a-84a0-4774-9d28-b3ed28591dc5+16:3301:x1874687714946432:12345-0@lo:103: 00010000:00010000:2.0:1787841674.913973:0:7632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787841674.913977:0:7632:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92cbc6725000/0xe3dac0c99affe1f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe3dac0c99affe1f0 expref: 16 pid: 5832 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841674.913985:0:7632:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92cbc6725000/0xe3dac0c99affe1f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe3dac0c99affe1f0 expref: 16 pid: 5832 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841674.913995:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92cbc6725000/0xe3dac0c99affe1f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe3dac0c99affe1f0 expref: 16 pid: 5832 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841674.914004:0:7632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787841674.914053:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbd4a9e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f6e7591a-84a0-4774-9d28-b3ed28591dc5+15:3301:x1874687714946432:12345-0@lo:103: Request processed in 88us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841674.914061:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787841674.914067:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf07fb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3301:1874687714946432:0@lo:103: 00010000:00010000:3.0:1787841674.914076:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92cbc169b800/0xe3dac0c99affe1bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe3dac0c99affe1b8 expref: 14 pid: 5833 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841674.914087:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92cbc169b800/0xe3dac0c99affe1bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe3dac0c99affe1b8 expref: 14 pid: 5833 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841674.914098:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787841674.914145:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbd4a9f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+13:3298:x1874687714946688:12345-0@lo:103: Request processed in 479us (812us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841674.914153:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787841674.914161:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf8dcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3298:1874687714946688:0@lo:103: 00000100:00100000:0.0:1787841674.914211:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841674.914302:0:7633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714946816 00000100:00100000:1.0:1787841674.914306:0:7633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714946816 00010000:00010000:1.0:1787841674.914325:0:7633:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92cbc169b400/0xe3dac0c99affe195 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe3dac0c99affe18e expref: 13 pid: 5831 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841674.914350:0:7633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787841674.914356:0:7633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcdb7f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f6e7591a-84a0-4774-9d28-b3ed28591dc5+13:3300:x1874687714946816:12345-0@lo:103: 00010000:00010000:1.0:1787841674.914366:0:7633:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787841674.914370:0:7633:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92cbc169b400/0xe3dac0c99affe195 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe3dac0c99affe18e expref: 13 pid: 5831 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841674.914379:0:7633:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92cbc169b400/0xe3dac0c99affe195 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe3dac0c99affe18e expref: 13 pid: 5831 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841674.914389:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92cbc169b400/0xe3dac0c99affe195 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe3dac0c99affe18e expref: 13 pid: 5831 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841674.914399:0:7633:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787841674.914483:0:7633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcdb7f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f6e7591a-84a0-4774-9d28-b3ed28591dc5+12:3300:x1874687714946816:12345-0@lo:103: Request processed in 127us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841674.914490:0:7633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787841674.914576:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf8dcb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3300:1874687714946816:0@lo:103: 00000100:00100000:1.0:1787841674.930489:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841674.930630:0:8445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff3e8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1874687714944896:192.168.201.1@tcp:104: 00000100:00100000:3.0:1787841674.930647:0:8445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff3eb0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8445:1874687714945024:192.168.201.1@tcp:104: 00010000:00010000:3.0:1787841674.930727:0:8445:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff92cbc169a600/0xe3dac0c99affe298 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841674.930816:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841674.931426:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687694999680 00000100:00100000:2.0:1787841674.931434:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687694999680 00010000:00010000:2.0:1787841674.931475:0:7632:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92cbc149c600/0xe3dac0c99affe260 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d66a0 expref: 10 pid: 5833 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841674.935642:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687694999808 00000100:00100000:2.0:1787841674.935685:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687694999808 00010000:00010000:2.0:1787841674.937274:0:7632:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92cbc6598800/0xe3dac0c99affe259 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6699 expref: 11 pid: 5831 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841674.937534:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 19 00000100:00100000:3.0:1787841674.937551:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e64780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09a1f1ce-26b5-4cc6-a1db-8e09063432da+11:2354:x1874687694999680:12345-192.168.201.1@tcp:103: 00010000:00010000:3.0:1787841674.937591:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787841674.937600:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92cbc149c600/0xe3dac0c99affe260 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d66a0 expref: 11 pid: 5833 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841674.937615:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92cbc149c600/0xe3dac0c99affe260 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d66a0 expref: 11 pid: 5833 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841674.937640:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92cbc149c600/0xe3dac0c99affe260 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d66a0 expref: 11 pid: 5833 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841674.937662:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787841674.937780:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e64780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09a1f1ce-26b5-4cc6-a1db-8e09063432da+10:2354:x1874687694999680:12345-192.168.201.1@tcp:103: Request processed in 235us (7303us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841674.937789:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 19 00000100:00100000:3.0:1787841674.937820:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 20 00000100:00100000:3.0:1787841674.937827:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e65680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09a1f1ce-26b5-4cc6-a1db-8e09063432da+9:2354:x1874687694999808:12345-192.168.201.1@tcp:103: 00010000:00010000:3.0:1787841674.937837:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787841674.937842:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92cbc6598800/0xe3dac0c99affe259 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6699 expref: 9 pid: 5831 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841674.937852:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92cbc6598800/0xe3dac0c99affe259 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6699 expref: 9 pid: 5831 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841674.937863:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92cbc6598800/0xe3dac0c99affe259 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6699 expref: 9 pid: 5831 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841674.937874:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff92cbc169a600/0xe3dac0c99affe298 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841674.937895:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92cbc169a600/0xe3dac0c99affe298 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841674.937912:0:5825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92cbc169a600/0xe3dac0c99affe298 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841674.937920:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92cbc169a600/0xe3dac0c99affe298 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841674.937925:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff92cbc169a600/0xe3dac0c99affe298 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841674.937932:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff92cbc169a600/0xe3dac0c99affe298 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841674.937938:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc169a600 already unused, calling callback (ffffffffc17a4500) 00010000:00010000:3.0:1787841674.937942:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff92cbc169a600/0xe3dac0c99affe298 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841674.937949:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff92cbc169a600/0xe3dac0c99affe298 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841674.937970:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff92cbc169a600/0xe3dac0c99affe298 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841674.937981:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787841674.938003:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e65680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09a1f1ce-26b5-4cc6-a1db-8e09063432da+8:2354:x1874687694999808:12345-192.168.201.1@tcp:103: Request processed in 176us (7203us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841674.938010:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 20 00010000:00010000:3.0:1787841674.938062:0:8445:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff92cbc169a600/0xe3dac0c99affe298 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841674.938077:0:8445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff92cbc169a600/0xe3dac0c99affe298 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841674.938083:0:8445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92cbc169a600/0xe3dac0c99affe298 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841675.842631:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787841675.921146:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841675.921197:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841675.921236:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841675.921273:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841675.921357:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695000192 00000100:00100000:1.0:1787841675.921367:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695000192 00000100:00100000:1.0:1787841675.921439:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695000320 00000100:00100000:1.0:1787841675.921443:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695000320 00000100:00100000:1.0:1787841675.921464:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 10 00000100:00100000:1.0:1787841675.921472:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf8e80780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b2767a54-6703-4908-8414-eab6601e2ceb+5:2356:x1874687695000192:12345-192.168.201.1@tcp:400: 00000100:00100000:1.0:1787841675.921565:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf8e80780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b2767a54-6703-4908-8414-eab6601e2ceb+5:2356:x1874687695000192:12345-192.168.201.1@tcp:400: Request processed in 94us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841675.921574:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 10 00000100:00100000:1.0:1787841675.921594:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 11 00000100:00100000:1.0:1787841675.921600:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf8e83c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b2767a54-6703-4908-8414-eab6601e2ceb+5:2356:x1874687695000320:12345-192.168.201.1@tcp:400: 00000100:00100000:1.0:1787841675.921626:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf8e83c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b2767a54-6703-4908-8414-eab6601e2ceb+5:2356:x1874687695000320:12345-192.168.201.1@tcp:400: Request processed in 26us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841675.921631:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 11 00000100:00080000:0.0:1787841675.921846:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787841675.921850:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787841675.921958:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695000064 00000100:00100000:3.0:1787841675.921964:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695000064 00000100:00100000:3.0:1787841675.922024:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 27 00000100:00100000:3.0:1787841675.922032:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf8e82580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+6:2356:x1874687695000064:12345-192.168.201.1@tcp:400: 00000100:00100000:3.0:1787841675.922079:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf8e82580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+6:2356:x1874687695000064:12345-192.168.201.1@tcp:400: Request processed in 48us (841us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841675.922086:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 27 00000100:00080000:0.0:1787841675.922200:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787841675.922607:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687694999936 00000100:00100000:2.0:1787841675.922613:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687694999936 00000100:00100000:2.0:1787841675.922654:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 132 00000100:00100000:2.0:1787841675.922661:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe9a1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a1f1ce-26b5-4cc6-a1db-8e09063432da+8:2356:x1874687694999936:12345-192.168.201.1@tcp:400: 00000100:00100000:2.0:1787841675.922730:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe9a1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a1f1ce-26b5-4cc6-a1db-8e09063432da+8:2356:x1874687694999936:12345-192.168.201.1@tcp:400: Request processed in 69us (1595us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841675.922736:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 132 00000100:00100000:1.0:1787841676.240566:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841676.240744:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695000448 00000100:00100000:2.0:1787841676.240754:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695000448 00000100:00100000:2.0:1787841676.240812:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 133 00000100:00100000:2.0:1787841676.240822:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe9a1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a1f1ce-26b5-4cc6-a1db-8e09063432da+8:5607:x1874687695000448:12345-192.168.201.1@tcp:101: 00010000:00010000:2.0:1787841676.240839:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841676.240862:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92cbc6599600/0xe3dac0c99affe29f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6702 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841676.240892:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92cbc6599600/0xe3dac0c99affe29f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6702 expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841676.240904:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92cbc6599600/0xe3dac0c99affe29f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6702 expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841676.240914:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc6599600, rc 0) 00000100:00100000:2.0:1787841676.240978:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe9a1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a1f1ce-26b5-4cc6-a1db-8e09063432da+9:5607:x1874687695000448:12345-192.168.201.1@tcp:101: Request processed in 157us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841676.241017:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 133 00000100:00100000:0.0:1787841676.246120:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841676.248010:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695000576 00000100:00100000:1.0:1787841676.248024:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695000576 00000100:00100000:1.0:1787841676.248101:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 134 00000100:00100000:1.0:1787841676.248112:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe9a1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a1f1ce-26b5-4cc6-a1db-8e09063432da+9:5607:x1874687695000576:12345-192.168.201.1@tcp:501: 00000100:00100000:1.0:1787841676.248441:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe9a1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a1f1ce-26b5-4cc6-a1db-8e09063432da+9:5607:x1874687695000576:12345-192.168.201.1@tcp:501: Request processed in 329us (2332us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841676.248448:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 134 00000100:00100000:3.0:1787841676.251834:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841676.252439:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695000704 00000100:00100000:2.0:1787841676.252451:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695000704 00000100:00100000:2.0:1787841676.252514:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 135 00000100:00100000:2.0:1787841676.252526:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe9a19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a1f1ce-26b5-4cc6-a1db-8e09063432da+9:5607:x1874687695000704:12345-192.168.201.1@tcp:503: 00000100:00100000:2.0:1787841676.252856:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe9a19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a1f1ce-26b5-4cc6-a1db-8e09063432da+9:5607:x1874687695000704:12345-192.168.201.1@tcp:503: Request processed in 331us (1031us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841676.252865:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 135 00000100:00100000:2.0:1787841676.260893:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841676.263771:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695000832 00000100:00100000:1.0:1787841676.263789:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695000832 00000100:00100000:1.0:1787841676.263874:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 136 00000100:00100000:1.0:1787841676.263886:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe9a1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a1f1ce-26b5-4cc6-a1db-8e09063432da+9:6080:x1874687695000832:12345-192.168.201.1@tcp:502: 00000100:00100000:1.0:1787841676.264510:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe9a1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a1f1ce-26b5-4cc6-a1db-8e09063432da+9:6080:x1874687695000832:12345-192.168.201.1@tcp:502: Request processed in 624us (3627us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841676.264519:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 136 00000100:00100000:0.0:1787841676.275539:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841676.275622:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695000960 00000100:00100000:3.0:1787841676.275633:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695000960 00000100:00100000:3.0:1787841676.275692:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 137 00000100:00100000:3.0:1787841676.275733:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe9a19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a1f1ce-26b5-4cc6-a1db-8e09063432da+9:6080:x1874687695000960:12345-192.168.201.1@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787841676.276053:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe9a19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a1f1ce-26b5-4cc6-a1db-8e09063432da+9:6080:x1874687695000960:12345-192.168.201.1@tcp:502:llog_process_th.0 Request processed in 320us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841676.276061:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 137 00000100:00100000:3.0:1787841676.279010:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841676.279131:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695001088 00000100:00100000:2.0:1787841676.279141:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695001088 00000100:00100000:2.0:1787841676.279194:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 138 00000100:00100000:2.0:1787841676.279203:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe9a18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a1f1ce-26b5-4cc6-a1db-8e09063432da+9:5607:x1874687695001088:12345-192.168.201.1@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787841676.279219:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841676.279236:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92cbc6598600/0xe3dac0c99affe2a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6709 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841676.279264:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92cbc6598600/0xe3dac0c99affe2a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6709 expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841676.279276:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92cbc6598600/0xe3dac0c99affe2a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6709 expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841676.279285:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc6598600, rc 0) 00000100:00100000:2.0:1787841676.279341:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe9a18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a1f1ce-26b5-4cc6-a1db-8e09063432da+10:5607:x1874687695001088:12345-192.168.201.1@tcp:101:ll_cfg_requeue.0 Request processed in 139us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841676.279349:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 138 00000100:00100000:2.0:1787841676.281826:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841676.282089:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695001216 00000100:00100000:3.0:1787841676.282099:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695001216 00000100:00100000:3.0:1787841676.282157:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 139 00000100:00100000:3.0:1787841676.282167:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe9a1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a1f1ce-26b5-4cc6-a1db-8e09063432da+10:5607:x1874687695001216:12345-192.168.201.1@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787841676.282519:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe9a1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a1f1ce-26b5-4cc6-a1db-8e09063432da+10:5607:x1874687695001216:12345-192.168.201.1@tcp:501:ll_cfg_requeue.0 Request processed in 353us (703us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787841676.282528:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 139 10000000:01000000:1.0:1787841676.353045:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787841676.353054:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff92cbff856800 from 39 10000000:01000000:1.0:1787841676.353093:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787841676.353153:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc169aa00/0xe3dac0c99affe2ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841676.353166:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff92cbc169aa00/0xe3dac0c99affe2ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841676.353177:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff92cbc169aa00/0xe3dac0c99affe2ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841676.353205:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e65a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714946944:0@lo:101: 00000100:00100000:1.0:1787841676.353310:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841676.353393:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbe771dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787841676.353541:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714946944 00000100:00100000:0.0:1787841676.353551:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714946944 00000100:00100000:0.0:1787841676.353602:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787841676.353618:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe9a1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+12:5836:x1874687714946944:12345-0@lo:101: 00010000:00010000:0.0:1787841676.353632:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841676.353646:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92cbc6725e00/0xe3dac0c99affe2b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe3dac0c99affe2ad expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841676.353670:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92cbc6725e00/0xe3dac0c99affe2b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe3dac0c99affe2ad expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841676.353681:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92cbc6725e00/0xe3dac0c99affe2b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe3dac0c99affe2ad expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841676.353690:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc6725e00, rc 0) 00000100:00100000:0.0:1787841676.353764:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe9a1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+13:5836:x1874687714946944:12345-0@lo:101: Request processed in 147us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841676.353771:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1787841676.354911:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e65a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714946944:0@lo:101: 00010000:00010000:1.0:1787841676.354932:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff92cbc169aa00/0xe3dac0c99affe2ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe2b4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841676.354943:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff92cbc169aa00/0xe3dac0c99affe2ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe3dac0c99affe2b4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841676.355025:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e65a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714947072:0@lo:501: 00000100:00100000:1.0:1787841676.355086:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841676.355124:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbe771dc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787841676.355237:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714947072 00000100:00100000:2.0:1787841676.355243:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714947072 00000100:00100000:2.0:1787841676.355287:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1787841676.355296:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe9a18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+13:5836:x1874687714947072:12345-0@lo:501: 00000100:00100000:2.0:1787841676.355574:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe9a18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+13:5836:x1874687714947072:12345-0@lo:501: Request processed in 278us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841676.355582:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787841676.355729:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e65a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714947072:0@lo:501: 00000100:00100000:1.0:1787841676.355762:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e65a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714947200:0@lo:503: 00000100:00100000:1.0:1787841676.355878:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841676.355905:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbe771dc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787841676.355960:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714947200 00000100:00100000:3.0:1787841676.355964:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714947200 00000100:00100000:3.0:1787841676.355998:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787841676.356015:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe9a18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+13:5836:x1874687714947200:12345-0@lo:503: 00000100:00100000:3.0:1787841676.356185:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe9a18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+13:5836:x1874687714947200:12345-0@lo:503: Request processed in 171us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841676.356191:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787841676.356360:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e65a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714947200:0@lo:503: 00000100:00100000:2.0:1787841676.356730:0:8461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4a9cb40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f6e7591a-84a0-4774-9d28-b3ed28591dc5:8461:1874687714947328:0@lo:502: 00000100:00100000:2.0:1787841676.356769:0:8461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841676.356804:0:8461:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbf0515240 going to sleep for 11 seconds 00000100:00100000:0.0:1787841676.356903:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714947328 00000100:00100000:0.0:1787841676.356908:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714947328 00000100:00100000:0.0:1787841676.356939:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1787841676.356946:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe9a19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+13:8461:x1874687714947328:12345-0@lo:502: 00000100:00100000:0.0:1787841676.357144:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe9a19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+13:8461:x1874687714947328:12345-0@lo:502: Request processed in 198us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841676.357150:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1787841676.357276:0:8461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4a9cb40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f6e7591a-84a0-4774-9d28-b3ed28591dc5:8461:1874687714947328:0@lo:502: 00000100:00100000:2.0:1787841676.357312:0:8461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4a9cb40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f6e7591a-84a0-4774-9d28-b3ed28591dc5:8461:1874687714947456:0@lo:502: 00000100:00100000:2.0:1787841676.357341:0:8461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841676.357362:0:8461:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbf0515240 going to sleep for 11 seconds 00000100:00100000:1.0:1787841676.357415:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714947456 00000100:00100000:1.0:1787841676.357419:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714947456 00000100:00100000:1.0:1787841676.357448:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787841676.357455:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe9a18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+13:8461:x1874687714947456:12345-0@lo:502: 00000100:00100000:1.0:1787841676.357591:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe9a18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+13:8461:x1874687714947456:12345-0@lo:502: Request processed in 136us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841676.357599:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787841676.357677:0:8461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4a9cb40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f6e7591a-84a0-4774-9d28-b3ed28591dc5:8461:1874687714947456:0@lo:502: 00000040:00080000:2.0:1787841676.357719:0:8461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1787841676.357945:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1787841676.357970:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787841676.357981:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc169aa00/0xe3dac0c99affe2ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe2b4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841676.357993:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff92cbc169aa00/0xe3dac0c99affe2ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe2b4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787841676.358012:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1787841676.358015:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:1.0:1787841676.358018:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1787841676.358043:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc169a400/0xe3dac0c99affe2bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841676.358051:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff92cbc169a400/0xe3dac0c99affe2bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841676.358062:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff92cbc169a400/0xe3dac0c99affe2bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841676.358085:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e65a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714947584:0@lo:101: 00000100:00100000:1.0:1787841676.358115:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841676.358152:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbe771db40 going to sleep for 11 seconds 00000100:00100000:2.0:1787841676.358264:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714947584 00000100:00100000:2.0:1787841676.358270:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714947584 00000100:00100000:2.0:1787841676.358293:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1787841676.358299:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+13:5836:x1874687714947584:12345-0@lo:101: 00010000:00010000:2.0:1787841676.358309:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841676.358322:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92cbc6598400/0xe3dac0c99affe2c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe3dac0c99affe2bb expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841676.358344:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92cbc6598400/0xe3dac0c99affe2c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe3dac0c99affe2bb expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841676.358361:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92cbc6598400/0xe3dac0c99affe2c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe3dac0c99affe2bb expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841676.358370:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc6598400, rc 0) 00000100:00100000:2.0:1787841676.358408:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+14:5836:x1874687714947584:12345-0@lo:101: Request processed in 109us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841676.358413:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787841676.359193:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e65a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714947584:0@lo:101: 00010000:00010000:1.0:1787841676.359210:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff92cbc169a400/0xe3dac0c99affe2bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe2c2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841676.359220:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff92cbc169a400/0xe3dac0c99affe2bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe3dac0c99affe2c2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841676.359273:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e65a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714947712:0@lo:501: 00000100:00100000:1.0:1787841676.359303:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841676.359335:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbe771db40 going to sleep for 11 seconds 00000100:00100000:2.0:1787841676.360960:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714947712 00000100:00100000:2.0:1787841676.360974:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714947712 00000100:00100000:2.0:1787841676.361056:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787841676.361065:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+14:5836:x1874687714947712:12345-0@lo:501: 00000100:00100000:2.0:1787841676.361422:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+14:5836:x1874687714947712:12345-0@lo:501: Request processed in 356us (2115us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841676.361430:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787841676.361659:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e65a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714947712:0@lo:501: 00000100:00100000:1.0:1787841676.361772:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e65a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714947840:0@lo:503: 00000100:00100000:1.0:1787841676.361841:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841676.361872:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbe771db40 going to sleep for 11 seconds 00000100:00100000:0.0:1787841676.362096:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714947840 00000100:00100000:0.0:1787841676.362101:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714947840 00000100:00100000:0.0:1787841676.362141:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1787841676.362150:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+14:5836:x1874687714947840:12345-0@lo:503: 00000100:00100000:0.0:1787841676.362380:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+14:5836:x1874687714947840:12345-0@lo:503: Request processed in 230us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841676.362397:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787841676.362844:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e65a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714947840:0@lo:503: 00000100:00100000:1.0:1787841676.365387:0:8462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e65a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f6e7591a-84a0-4774-9d28-b3ed28591dc5:8462:1874687714947968:0@lo:502: 00000100:00100000:1.0:1787841676.365486:0:8462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841676.365530:0:8462:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbe771d540 going to sleep for 11 seconds 00000100:00100000:0.0:1787841676.366901:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714947968 00000100:00100000:0.0:1787841676.366913:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714947968 00000100:00100000:0.0:1787841676.366985:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1787841676.366996:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+14:8462:x1874687714947968:12345-0@lo:502: 00000100:00100000:0.0:1787841676.368258:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+14:8462:x1874687714947968:12345-0@lo:502: Request processed in 1254us (2762us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841676.368269:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787841676.368465:0:8462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e65a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f6e7591a-84a0-4774-9d28-b3ed28591dc5:8462:1874687714947968:0@lo:502: 00000020:01000000:1.0:1787841676.368508:0:8462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787841676.368518:0:8462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787841676.368520:0:8462:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787841676.368525:0:8462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787841676.368563:0:8462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e65a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f6e7591a-84a0-4774-9d28-b3ed28591dc5:8462:1874687714948096:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787841676.368618:0:8462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841676.368671:0:8462:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbe771d540 going to sleep for 11 seconds 00000100:00100000:2.0:1787841676.368740:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714948096 00000100:00100000:2.0:1787841676.368747:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714948096 00000100:00100000:2.0:1787841676.368907:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787841676.368916:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+14:8462:x1874687714948096:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787841676.369102:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+14:8462:x1874687714948096:12345-0@lo:502:llog_process_th.0 Request processed in 187us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841676.369110:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787841676.372350:0:8462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e65a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f6e7591a-84a0-4774-9d28-b3ed28591dc5:8462:1874687714948096:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787841676.372407:0:8462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787841676.372418:0:8462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787841676.372421:0:8462:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787841676.372425:0:8462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1787841676.374766:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1787841676.374815:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1787841676.374827:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc169a400/0xe3dac0c99affe2bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe2c2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841676.374839:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff92cbc169a400/0xe3dac0c99affe2bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe2c2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787841676.374849:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787841676.374852:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff92cbf04e3800 from 39 10000000:01000000:0.0:1787841676.374855:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787841676.374893:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc6725000/0xe3dac0c99affe2c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841676.374901:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff92cbc6725000/0xe3dac0c99affe2c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841676.374911:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff92cbc6725000/0xe3dac0c99affe2c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841676.374935:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf8e821c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714948224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787841676.375030:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841676.383884:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbf71bad80 going to sleep for 11 seconds 00000100:00100000:3.0:1787841676.387971:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714948224 00000100:00100000:3.0:1787841676.388009:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714948224 00000100:00100000:3.0:1787841676.388099:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787841676.388110:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+14:5836:x1874687714948224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787841676.388129:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841676.388148:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92cbc149c600/0xe3dac0c99affe2d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe3dac0c99affe2c9 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841676.388177:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92cbc149c600/0xe3dac0c99affe2d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe3dac0c99affe2c9 expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841676.388187:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92cbc149c600/0xe3dac0c99affe2d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe3dac0c99affe2c9 expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841676.388197:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc149c600, rc 0) 00000100:00100000:3.0:1787841676.388282:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+15:5836:x1874687714948224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 175us (13252us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841676.388312:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787841676.388544:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf8e821c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714948224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787841676.388563:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff92cbc6725000/0xe3dac0c99affe2c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe2d0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841676.388573:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff92cbc6725000/0xe3dac0c99affe2c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe3dac0c99affe2d0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841676.388654:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf8e821c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714948352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787841676.388745:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841676.388775:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbf71bad80 going to sleep for 11 seconds 00000100:00100000:2.0:1787841676.389023:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714948352 00000100:00100000:2.0:1787841676.389029:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714948352 00000100:00100000:2.0:1787841676.389060:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787841676.389068:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+15:5836:x1874687714948352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787841676.389346:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+15:5836:x1874687714948352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 279us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841676.389361:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787841676.397597:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf8e821c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714948352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787841676.397687:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf8e821c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714948480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787841676.397842:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841676.397891:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbf71bad80 going to sleep for 11 seconds 00000100:00100000:1.0:1787841676.398376:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714948480 00000100:00100000:1.0:1787841676.398385:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714948480 00000100:00100000:1.0:1787841676.398444:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787841676.398454:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+15:5836:x1874687714948480:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787841676.398667:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+15:5836:x1874687714948480:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 214us (825us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841676.398676:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1787841676.398843:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf8e821c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714948480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787841676.401611:0:8463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf8e821c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f6e7591a-84a0-4774-9d28-b3ed28591dc5:8463:1874687714948608:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787841676.401733:0:8463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841676.401787:0:8463:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbf71baf00 going to sleep for 11 seconds 00000100:00100000:1.0:1787841676.401962:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714948608 00000100:00100000:1.0:1787841676.401969:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714948608 00000100:00100000:1.0:1787841676.402038:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787841676.402048:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+15:8463:x1874687714948608:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787841676.402327:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+15:8463:x1874687714948608:12345-0@lo:502:llog_process_th.0 Request processed in 279us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841676.402335:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787841676.402544:0:8463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf8e821c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f6e7591a-84a0-4774-9d28-b3ed28591dc5:8463:1874687714948608:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787841676.402596:0:8463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf8e821c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f6e7591a-84a0-4774-9d28-b3ed28591dc5:8463:1874687714948736:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787841676.402632:0:8463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841676.402662:0:8463:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbf71baf00 going to sleep for 11 seconds 00000100:00100000:3.0:1787841676.402731:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714948736 00000100:00100000:3.0:1787841676.402735:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714948736 00000100:00100000:3.0:1787841676.402762:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787841676.402769:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+15:8463:x1874687714948736:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787841676.402920:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+15:8463:x1874687714948736:12345-0@lo:502:llog_process_th.0 Request processed in 152us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841676.402927:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787841676.403092:0:8463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf8e821c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f6e7591a-84a0-4774-9d28-b3ed28591dc5:8463:1874687714948736:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1787841676.403112:0:8463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1787841676.404902:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1787841676.404937:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787841676.404949:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc6725000/0xe3dac0c99affe2c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe2d0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841676.404961:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff92cbc6725000/0xe3dac0c99affe2c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe2d0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787841676.404990:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1787841676.404993:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:1.0:1787841676.404996:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1787841676.405043:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc169b800/0xe3dac0c99affe2d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841676.405052:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff92cbc169b800/0xe3dac0c99affe2d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841676.405062:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff92cbc169b800/0xe3dac0c99affe2d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841676.405164:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e65a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714948864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787841676.405222:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841676.405271:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbe771da80 going to sleep for 11 seconds 00000100:00100000:1.0:1787841676.405295:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714948864 00000100:00100000:1.0:1787841676.405301:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714948864 00000100:00100000:1.0:1787841676.405352:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787841676.405361:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+15:5836:x1874687714948864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787841676.405374:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841676.405386:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92cbc169be00/0xe3dac0c99affe2de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xe3dac0c99affe2d7 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841676.405409:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92cbc169be00/0xe3dac0c99affe2de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe3dac0c99affe2d7 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841676.405420:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92cbc169be00/0xe3dac0c99affe2de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe3dac0c99affe2d7 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841676.405439:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc169be00, rc 0) 00000100:00100000:1.0:1787841676.405477:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+16:5836:x1874687714948864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841676.405484:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787841676.405652:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e65a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714948864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787841676.405666:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff92cbc169b800/0xe3dac0c99affe2d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe2de expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841676.405676:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff92cbc169b800/0xe3dac0c99affe2d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe3dac0c99affe2de expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841676.405762:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4a9cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714948992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787841676.405891:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841676.405913:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbf0515c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787841676.410243:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714948992 00000100:00100000:1.0:1787841676.410262:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714948992 00000100:00100000:1.0:1787841676.410326:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787841676.410337:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+16:5836:x1874687714948992:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787841676.410680:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+16:5836:x1874687714948992:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 343us (4787us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841676.410688:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787841676.413012:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4a9cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714948992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787841676.413094:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4a9cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714949120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787841676.413184:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841676.413227:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbf0515c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787841676.413934:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714949120 00000100:00100000:3.0:1787841676.413941:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714949120 00000100:00100000:3.0:1787841676.414012:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787841676.414023:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+16:5836:x1874687714949120:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787841676.414240:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+16:5836:x1874687714949120:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 218us (1056us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841676.414248:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787841676.414530:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4a9cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714949120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787841676.417019:0:8464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4a9cb40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f6e7591a-84a0-4774-9d28-b3ed28591dc5:8464:1874687714949248:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787841676.417115:0:8464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841676.417165:0:8464:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbf0515780 going to sleep for 11 seconds 00000100:00100000:3.0:1787841676.417308:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714949248 00000100:00100000:3.0:1787841676.417317:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714949248 00000100:00100000:3.0:1787841676.417366:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787841676.417375:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+16:8464:x1874687714949248:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787841676.417605:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+16:8464:x1874687714949248:12345-0@lo:502:llog_process_th.0 Request processed in 230us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841676.417613:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787841676.417750:0:8464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4a9cb40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f6e7591a-84a0-4774-9d28-b3ed28591dc5:8464:1874687714949248:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787841676.417793:0:8464:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787841676.417802:0:8464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787841676.417806:0:8464:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787841676.417812:0:8464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1787841676.417834:0:8464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf8e821c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f6e7591a-84a0-4774-9d28-b3ed28591dc5:8464:1874687714949376:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787841676.417870:0:8464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841676.417889:0:8464:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbf71baf00 going to sleep for 11 seconds 00000100:00100000:1.0:1787841676.418386:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714949376 00000100:00100000:1.0:1787841676.418392:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714949376 00000100:00100000:1.0:1787841676.418431:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787841676.418439:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+16:8464:x1874687714949376:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787841676.418611:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+16:8464:x1874687714949376:12345-0@lo:502:llog_process_th.0 Request processed in 172us (740us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841676.418619:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1787841676.419205:0:8464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf8e821c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f6e7591a-84a0-4774-9d28-b3ed28591dc5:8464:1874687714949376:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787841676.419240:0:8464:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787841676.419247:0:8464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787841676.419250:0:8464:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787841676.419254:0:8464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:2.0:1787841676.419546:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1787841676.419576:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787841676.419587:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc169b800/0xe3dac0c99affe2d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe2de expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841676.419598:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff92cbc169b800/0xe3dac0c99affe2d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe2de expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787841676.419618:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787841676.419620:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff92cbc3ed8000 from 39 10000000:01000000:2.0:1787841676.419622:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787841676.419652:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc6599e00/0xe3dac0c99affe2e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841676.419660:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff92cbc6599e00/0xe3dac0c99affe2e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841676.419670:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff92cbc6599e00/0xe3dac0c99affe2e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841676.419691:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4a9e1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714949504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787841676.419768:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841676.419880:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbf0515e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787841676.420081:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714949504 00000100:00100000:1.0:1787841676.420087:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714949504 00000100:00100000:1.0:1787841676.420134:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787841676.420142:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+16:5836:x1874687714949504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787841676.420156:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841676.420169:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92cbc169b400/0xe3dac0c99affe2ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xe3dac0c99affe2e5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841676.420204:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92cbc169b400/0xe3dac0c99affe2ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe3dac0c99affe2e5 expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841676.420214:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92cbc169b400/0xe3dac0c99affe2ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe3dac0c99affe2e5 expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841676.420223:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc169b400, rc 0) 00000100:00100000:1.0:1787841676.420270:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+17:5836:x1874687714949504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841676.420276:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787841676.421206:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4a9e1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714949504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787841676.421227:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff92cbc6599e00/0xe3dac0c99affe2e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe2ec expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841676.421237:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff92cbc6599e00/0xe3dac0c99affe2e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xe3dac0c99affe2ec expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841676.421303:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4a9e1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714949632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787841676.421340:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841676.421419:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbf0515e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787841676.428717:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714949632 00000100:00100000:0.0:1787841676.428738:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714949632 00000100:00100000:0.0:1787841676.429281:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1787841676.429295:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+17:5836:x1874687714949632:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787841676.429634:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+17:5836:x1874687714949632:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 343us (8292us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841676.429642:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787841676.431755:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4a9e1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714949632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787841676.431898:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4a9e1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714949760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787841676.431997:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841676.432069:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714949760 00000100:00100000:2.0:1787841676.432070:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbf0515e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787841676.432076:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714949760 00000100:00100000:1.0:1787841676.432131:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787841676.432142:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+17:5836:x1874687714949760:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787841676.432392:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+17:5836:x1874687714949760:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 251us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841676.432400:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787841676.432460:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4a9e1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714949760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787841676.442342:0:8465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf8e821c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f6e7591a-84a0-4774-9d28-b3ed28591dc5:8465:1874687714949888:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787841676.442440:0:8465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841676.442501:0:8465:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbf71baf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787841676.442595:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714949888 00000100:00100000:2.0:1787841676.442603:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714949888 00000100:00100000:2.0:1787841676.442655:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1787841676.442664:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+17:8465:x1874687714949888:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787841676.442968:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+17:8465:x1874687714949888:12345-0@lo:502:llog_process_th.0 Request processed in 304us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841676.442976:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1787841676.443012:0:8465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf8e821c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f6e7591a-84a0-4774-9d28-b3ed28591dc5:8465:1874687714949888:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787841676.443062:0:8465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e661c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f6e7591a-84a0-4774-9d28-b3ed28591dc5:8465:1874687714950016:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787841676.443097:0:8465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841676.443126:0:8465:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbe771d180 going to sleep for 11 seconds 00000100:00100000:2.0:1787841676.443270:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714950016 00000100:00100000:2.0:1787841676.443274:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714950016 00000100:00100000:2.0:1787841676.443309:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1787841676.443317:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+17:8465:x1874687714950016:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787841676.443459:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+17:8465:x1874687714950016:12345-0@lo:502:llog_process_th.0 Request processed in 142us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841676.443466:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787841676.443489:0:8465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e661c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f6e7591a-84a0-4774-9d28-b3ed28591dc5:8465:1874687714950016:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1787841676.443512:0:8465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1787841676.445148:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1787841676.445182:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787841676.445194:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc6599e00/0xe3dac0c99affe2e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe2ec expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841676.445205:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff92cbc6599e00/0xe3dac0c99affe2e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe2ec expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787841676.445217:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1787841676.445220:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1787841676.445237:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787841676.445270:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc6599400/0xe3dac0c99affe2f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841676.445278:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff92cbc6599400/0xe3dac0c99affe2f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841676.445289:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff92cbc6599400/0xe3dac0c99affe2f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841676.445311:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4a9e1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714950144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787841676.445364:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841676.445409:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbf0515180 going to sleep for 11 seconds 00000100:00100000:1.0:1787841676.445506:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714950144 00000100:00100000:1.0:1787841676.445513:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714950144 00000100:00100000:1.0:1787841676.445563:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1787841676.445571:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+17:5836:x1874687714950144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787841676.445583:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841676.445595:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92cbc169a600/0xe3dac0c99affe2fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xe3dac0c99affe2f3 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841676.445618:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92cbc169a600/0xe3dac0c99affe2fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe3dac0c99affe2f3 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841676.445629:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92cbc169a600/0xe3dac0c99affe2fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe3dac0c99affe2f3 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841676.445638:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc169a600, rc 0) 00000100:00100000:1.0:1787841676.445687:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+18:5836:x1874687714950144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841676.445694:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1787841676.445755:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4a9e1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714950144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787841676.445775:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff92cbc6599400/0xe3dac0c99affe2f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe2fa expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841676.445862:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff92cbc6599400/0xe3dac0c99affe2f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xe3dac0c99affe2fa expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841676.445922:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf8e821c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714950272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787841676.445950:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841676.445981:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbf71bacc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787841676.446298:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714950272 00000100:00100000:2.0:1787841676.446303:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714950272 00000100:00100000:2.0:1787841676.446341:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1787841676.446349:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+18:5836:x1874687714950272:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787841676.446602:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+18:5836:x1874687714950272:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 253us (650us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841676.446609:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1787841676.446727:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf8e821c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714950272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787841676.446765:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf8e821c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714950400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787841676.447184:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841676.447197:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714950400 00000100:00100000:1.0:1787841676.447202:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714950400 00000100:00100000:0.0:1787841676.447207:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbf71bacc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787841676.447224:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1787841676.447231:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+18:5836:x1874687714950400:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787841676.447396:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+18:5836:x1874687714950400:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 165us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841676.447404:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1787841676.447603:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf8e821c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714950400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787841676.449386:0:8466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4bac780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f6e7591a-84a0-4774-9d28-b3ed28591dc5:8466:1874687714950528:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787841676.449478:0:8466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841676.449532:0:8466:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc82edc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787841676.449613:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714950528 00000100:00100000:0.0:1787841676.449620:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714950528 00000100:00100000:0.0:1787841676.449748:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1787841676.449759:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+18:8466:x1874687714950528:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787841676.450048:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+18:8466:x1874687714950528:12345-0@lo:502:llog_process_th.0 Request processed in 290us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841676.450056:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1787841676.450322:0:8466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4bac780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f6e7591a-84a0-4774-9d28-b3ed28591dc5:8466:1874687714950528:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787841676.450357:0:8466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787841676.450368:0:8466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787841676.450371:0:8466:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787841676.450378:0:8466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787841676.450404:0:8466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4bac780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f6e7591a-84a0-4774-9d28-b3ed28591dc5:8466:1874687714950656:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787841676.450439:0:8466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841676.459845:0:8466:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc82edc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787841676.461430:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714950656 00000100:00100000:2.0:1787841676.461447:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714950656 00000100:00100000:2.0:1787841676.461510:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1787841676.461520:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+18:8466:x1874687714950656:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787841676.464225:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+18:8466:x1874687714950656:12345-0@lo:502:llog_process_th.0 Request processed in 2694us (13773us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841676.464240:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1787841676.465891:0:8466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4bac780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f6e7591a-84a0-4774-9d28-b3ed28591dc5:8466:1874687714950656:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787841676.465946:0:8466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787841676.465958:0:8466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787841676.465960:0:8466:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787841676.465968:0:8466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1787841676.466351:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:2.0:1787841676.466386:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787841676.466397:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc6599400/0xe3dac0c99affe2f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe2fa expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841676.466409:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff92cbc6599400/0xe3dac0c99affe2f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe2fa expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787841676.466419:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1787841676.466422:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff92cbe9a69a48 from 1 10000000:01000000:2.0:1787841676.466424:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787841676.466458:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc6599200/0xe3dac0c99affe301 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841676.466465:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff92cbc6599200/0xe3dac0c99affe301 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841676.466474:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff92cbc6599200/0xe3dac0c99affe301 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841676.466495:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4a9f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714950784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787841676.466555:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841676.466604:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbf0515180 going to sleep for 11 seconds 00000100:00100000:3.0:1787841676.466891:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714950784 00000100:00100000:3.0:1787841676.466898:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714950784 00000100:00100000:3.0:1787841676.466937:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1787841676.466946:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+18:5836:x1874687714950784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787841676.466959:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841676.466973:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92cbc149c200/0xe3dac0c99affe308 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xe3dac0c99affe301 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841676.467012:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92cbc149c200/0xe3dac0c99affe308 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe3dac0c99affe301 expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841676.467024:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92cbc149c200/0xe3dac0c99affe308 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe3dac0c99affe301 expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841676.467032:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc149c200, rc 0) 00000100:00100000:3.0:1787841676.467069:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:5836:x1874687714950784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841676.467197:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4a9f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714950784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787841676.467213:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff92cbc6599200/0xe3dac0c99affe301 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe308 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841676.467221:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff92cbc6599200/0xe3dac0c99affe301 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xe3dac0c99affe308 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841676.467283:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4a9f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714950912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787841676.467316:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841676.467332:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbf0515180 going to sleep for 11 seconds 00000100:00100000:3.0:1787841676.467381:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1787841676.467406:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714950912 00000100:00100000:3.0:1787841676.467409:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714950912 00000100:00100000:3.0:1787841676.467423:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1787841676.467429:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:5836:x1874687714950912:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787841676.467667:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:5836:x1874687714950912:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 237us (350us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787841676.467675:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1787841676.468202:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4a9f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714950912:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1787841676.468241:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787841676.468250:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc6599200/0xe3dac0c99affe301 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe308 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841676.468259:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff92cbc6599200/0xe3dac0c99affe301 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe308 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841676.865858:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787841677.569283:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787841677.569307:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e661c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874687714951040:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787841677.569378:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841677.569652:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714951040 00000100:00100000:1.0:1787841677.569660:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714951040 00000100:00100000:1.0:1787841677.569753:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787841677.569763:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf8e821c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874687714951040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787841677.569801:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787841677.569865:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf8e821c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874687714951040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841677.569872:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1787841677.569915:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbf6e661c0 x1874687714951040/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841693 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787841677.569934:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e661c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874687714951040:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1787841677.571876:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787841677.581237:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf04c0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874687714951296:0@lo:400:kworker.0 00000100:00100000:0.0:1787841677.581321:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841677.581358:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787841677.581364:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf8e81680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3299:1874687714951168:0@lo:400:kworker.0 00000100:00100000:0.0:1787841677.581388:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841677.581409:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf04c1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1874687714951680:0@lo:400:kworker.0 00000100:00100000:0.0:1787841677.581427:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841677.581542:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714951296 00000100:00100000:3.0:1787841677.581550:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714951296 00000100:00100000:3.0:1787841677.581590:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714951680 00000100:00100000:3.0:1787841677.581593:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714951680 00000100:00100000:3.0:1787841677.581622:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787841677.581630:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf04c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874687714951296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787841677.581685:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf04c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874687714951296:12345-0@lo:400:kworker.0 Request processed in 55us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841677.581724:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787841677.581740:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787841677.581747:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf04c30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1874687714951680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787841677.581776:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf04c30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1874687714951680:12345-0@lo:400:kworker.0 Request processed in 30us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841677.581782:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787841677.581800:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf04c3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874687714951552:0@lo:400:kworker.0 00000100:00100000:3.0:1787841677.581827:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841677.581847:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787841677.581853:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf04c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1874687714951424:0@lo:400:kworker.0 00000100:00100000:3.0:1787841677.581883:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787841677.581905:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787841677.581932:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf04c1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1874687714951680:0@lo:400:kworker.0 00000100:00100000:3.0:1787841677.581942:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf04c0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874687714951296:0@lo:400:kworker.0 00000100:00100000:3.0:1787841677.581966:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714951424 00000100:00100000:3.0:1787841677.581969:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714951424 00000100:00100000:3.0:1787841677.582007:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787841677.582014:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbd4baf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874687714951424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787841677.582047:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbd4baf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874687714951424:12345-0@lo:400:kworker.0 Request processed in 33us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841677.582053:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1787841677.582065:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787841677.582079:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf04c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1874687714951424:0@lo:400:kworker.0 00000100:00100000:3.0:1787841677.582110:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714951168 00000100:00100000:3.0:1787841677.582113:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714951168 00000100:00100000:3.0:1787841677.582134:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1787841677.582140:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:3299:x1874687714951168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787841677.582173:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:3299:x1874687714951168:12345-0@lo:400:kworker.0 Request processed in 33us (784us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841677.582179:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1787841677.582201:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf8e81680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3299:1874687714951168:0@lo:400:kworker.0 00000100:00100000:1.0:1787841677.582363:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714951552 00000100:00100000:1.0:1787841677.582367:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714951552 00000100:00100000:1.0:1787841677.582407:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787841677.582413:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbd4bac780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1874687714951552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841677.582449:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbd4bac780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1874687714951552:12345-0@lo:400:kworker.0 Request processed in 37us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841677.582455:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1787841677.582483:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbf04c3840 x1874687714951552/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787841693 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787841677.582494:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf04c3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874687714951552:0@lo:400:kworker.0 00000100:00080000:3.0:1787841677.582551:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787841677.888950:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787841678.380642:0:8503:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe52e12700 20000000:00000080:0.0:1787841678.380662:0:8503:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff92cc009f2800 uarg=0000000000000000 20000000:01000000:0.0:1787841678.381064:0:8503:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787841678.381071:0:8503:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787841678.381075:0:8503:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1787841678.382169:0:8504:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:0.0:1787841678.382338:0:8503:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1787841678.389480:0:8503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1787841678.389541:0:8503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1787841678.390276:0:8503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1787841678.390300:0:8503:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787841678.390338:0:8503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff92cbc6724800/0xe3dac0c99affe30f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841678.390357:0:8503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92cbc149d400/0xe3dac0c99affe0d8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe3dac0c99affe0d1 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841678.390366:0:8503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92cbc169b600/0xe3dac0c99affe14f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe3dac0c99affe148 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841678.390372:0:8503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92cbc6724000/0xe3dac0c99affe1b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe3dac0c99affe1aa expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841678.390380:0:8503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92cbc6725c00/0xe3dac0c99affe26e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d66d1 expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841678.390399:0:8503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff92cbc6724800/0xe3dac0c99affe30f lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841678.390442:0:8503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92cbc6725c00/0xe3dac0c99affe26e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d66d1 expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841678.390458:0:8503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92cbc6725c00/0xe3dac0c99affe26e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d66d1 expref: 9 pid: 5832 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841678.390473:0:8503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf04c0b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8503:1874687714951808:192.168.201.1@tcp:104: 00010000:00010000:0.0:1787841678.390619:0:8503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92cbc6724000/0xe3dac0c99affe1b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe3dac0c99affe1aa expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841678.390628:0:8503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92cbc6724000/0xe3dac0c99affe1b1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe3dac0c99affe1aa expref: 18 pid: 5831 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841678.390638:0:8503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf04c2580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8503:1874687714951936:0@lo:104: 00000100:00100000:0.0:1787841678.390679:0:8503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787841678.390745:0:8503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92cbc169b600/0xe3dac0c99affe14f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe3dac0c99affe148 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841678.390754:0:8503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92cbc169b600/0xe3dac0c99affe14f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe3dac0c99affe148 expref: 18 pid: 5833 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841678.391037:0:8503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf04c2d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8503:1874687714952064:0@lo:104: 00000100:00100000:0.0:1787841678.391071:0:8503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787841678.391097:0:8503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92cbc149d400/0xe3dac0c99affe0d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe3dac0c99affe0d1 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841678.391117:0:8503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92cbc149d400/0xe3dac0c99affe0d8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe3dac0c99affe0d1 expref: 18 pid: 5832 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841678.391126:0:8503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf04c12c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8503:1874687714952192:0@lo:104: 00000100:00100000:0.0:1787841678.391149:0:8503:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbf71baf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787841678.392663:0:5821:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787841678.392733:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841678.392758:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714951936 00000100:00100000:2.0:1787841678.392775:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714951936 00000100:00100000:2.0:1787841678.392814:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714952064 00000100:00100000:2.0:1787841678.392817:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714952064 00000100:00100000:2.0:1787841678.392826:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714952192 00000100:00100000:2.0:1787841678.392827:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714952192 00000100:00100000:2.0:1787841678.392846:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787841678.392854:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf04c03c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+5:8503:x1874687714951936:12345-0@lo:104: 00010000:00010000:2.0:1787841678.392868:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.101@tcp lock: ffff92cbc149d600/0xe3dac0c99affe1aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe3dac0c99affe1b1 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841678.393182:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787841678.393189:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf04c03c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+5:8503:x1874687714951936:12345-0@lo:104: Request processed in 336us (2509us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841678.393197:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787841678.393231:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787841678.393238:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe7707c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+4:8503:x1874687714952064:12345-0@lo:104: 00010000:00010000:2.0:1787841678.393248:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.101@tcp lock: ffff92cbc169ac00/0xe3dac0c99affe148 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe3dac0c99affe14f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841678.393287:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787841678.393293:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe7707c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+4:8503:x1874687714952064:12345-0@lo:104: Request processed in 56us (2222us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841678.393299:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787841678.393338:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787841678.393345:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbd4a9e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+3:8503:x1874687714952192:12345-0@lo:104: 00010000:00010000:2.0:1787841678.393354:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.101@tcp lock: ffff92cbc149cc00/0xe3dac0c99affe0d1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe3dac0c99affe0d8 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841678.393383:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787841678.393388:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbd4a9e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+3:8503:x1874687714952192:12345-0@lo:104: Request processed in 44us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841678.393394:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1787841678.393417:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787841678.393423:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.101@tcp lock: ffff92cbc149d600/0xe3dac0c99affe1aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe3dac0c99affe1b1 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841678.393431:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc149d600 already unused, calling callback (ffffffffc1d9fc20) 10000000:00010000:2.0:1787841678.393435:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.101@tcp lock: ffff92cbc149d600/0xe3dac0c99affe1aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xe3dac0c99affe1b1 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841678.393444:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.101@tcp lock: ffff92cbc149d600/0xe3dac0c99affe1aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xe3dac0c99affe1b1 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787841678.393460:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.101@tcp lock: ffff92cbc149d600/0xe3dac0c99affe1aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xe3dac0c99affe1b1 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787841678.393466:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787841678.393508:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.101@tcp lock: ffff92cbc149d600/0xe3dac0c99affe1aa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99affe1b1 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841678.393514:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787841678.393535:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.101@tcp lock: ffff92cbc149d600/0xe3dac0c99affe1aa lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99affe1b1 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841678.393542:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.101@tcp lock: ffff92cbc149d600/0xe3dac0c99affe1aa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99affe1b1 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841678.393557:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787841678.393560:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.101@tcp lock: ffff92cbc169ac00/0xe3dac0c99affe148 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe3dac0c99affe14f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841678.393565:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc169ac00 already unused, calling callback (ffffffffc1d9fc20) 10000000:00010000:2.0:1787841678.393567:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.101@tcp lock: ffff92cbc169ac00/0xe3dac0c99affe148 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe3dac0c99affe14f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841678.393573:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.101@tcp lock: ffff92cbc169ac00/0xe3dac0c99affe148 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe3dac0c99affe14f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787841678.393578:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.101@tcp lock: ffff92cbc169ac00/0xe3dac0c99affe148 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe3dac0c99affe14f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787841678.394729:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787841678.395090:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.101@tcp lock: ffff92cbc169ac00/0xe3dac0c99affe148 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99affe14f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841678.395099:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787841678.395119:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.101@tcp lock: ffff92cbc169ac00/0xe3dac0c99affe148 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99affe14f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841678.395127:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.101@tcp lock: ffff92cbc169ac00/0xe3dac0c99affe148 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99affe14f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841678.395143:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787841678.395147:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.101@tcp lock: ffff92cbc149cc00/0xe3dac0c99affe0d1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe3dac0c99affe0d8 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841678.395153:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc149cc00 already unused, calling callback (ffffffffc1d9fc20) 10000000:00010000:2.0:1787841678.395156:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.101@tcp lock: ffff92cbc149cc00/0xe3dac0c99affe0d1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe3dac0c99affe0d8 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841678.395164:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.101@tcp lock: ffff92cbc149cc00/0xe3dac0c99affe0d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe3dac0c99affe0d8 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787841678.395170:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.101@tcp lock: ffff92cbc149cc00/0xe3dac0c99affe0d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe3dac0c99affe0d8 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787841678.395175:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787841678.395190:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.101@tcp lock: ffff92cbc149cc00/0xe3dac0c99affe0d1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99affe0d8 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841678.395196:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787841678.395202:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.101@tcp lock: ffff92cbc149cc00/0xe3dac0c99affe0d1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99affe0d8 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841678.395220:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.101@tcp lock: ffff92cbc149cc00/0xe3dac0c99affe0d1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99affe0d8 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841678.395235:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841678.395237:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841678.395239:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841678.395252:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787841678.395305:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4a9cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3299:1874687714952320:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787841678.395365:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841678.395648:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbcd44ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3300:1874687714952448:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787841678.395675:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841678.395735:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787841678.395741:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbcd4492c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3300:1874687714952576:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787841678.395776:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841678.395806:0:7633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714952320 00000100:00100000:1.0:1787841678.395812:0:7633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714952320 00010000:00010000:1.0:1787841678.395851:0:7633:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92cbc6724000/0xe3dac0c99affe1b1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe3dac0c99affe1aa expref: 19 pid: 5831 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841678.395888:0:7633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714952448 00000100:00100000:1.0:1787841678.395891:0:7633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714952448 00010000:00010000:1.0:1787841678.395903:0:7633:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92cbc169b600/0xe3dac0c99affe14f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe3dac0c99affe148 expref: 20 pid: 5833 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841678.396144:0:7633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714952576 00000100:00100000:1.0:1787841678.396149:0:7633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714952576 00010000:00010000:1.0:1787841678.396165:0:7633:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92cbc149d400/0xe3dac0c99affe0d8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe3dac0c99affe0d1 expref: 21 pid: 5832 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841678.396182:0:7633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787841678.396192:0:7633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd44bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f6e7591a-84a0-4774-9d28-b3ed28591dc5+21:3299:x1874687714952320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787841678.396207:0:7633:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787841678.396212:0:7633:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92cbc6724000/0xe3dac0c99affe1b1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe3dac0c99affe1aa expref: 21 pid: 5831 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841678.396223:0:7633:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92cbc6724000/0xe3dac0c99affe1b1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe3dac0c99affe1aa expref: 21 pid: 5831 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841678.396243:0:7633:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787841678.396283:0:7633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd44bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f6e7591a-84a0-4774-9d28-b3ed28591dc5+21:3299:x1874687714952320:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (918us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841678.396291:0:7633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787841678.396314:0:7633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787841678.396320:0:7633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e661c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f6e7591a-84a0-4774-9d28-b3ed28591dc5+20:3300:x1874687714952448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787841678.396328:0:7633:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787841678.396333:0:7633:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92cbc169b600/0xe3dac0c99affe14f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe3dac0c99affe148 expref: 20 pid: 5833 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841678.396353:0:7633:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92cbc169b600/0xe3dac0c99affe14f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe3dac0c99affe148 expref: 20 pid: 5833 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841678.396364:0:7633:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787841678.396393:0:7633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e661c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f6e7591a-84a0-4774-9d28-b3ed28591dc5+20:3300:x1874687714952448:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841678.396400:0:7633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787841678.396415:0:7633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787841678.396422:0:7633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e64f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:3300:x1874687714952576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787841678.396432:0:7633:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787841678.396436:0:7633:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92cbc149d400/0xe3dac0c99affe0d8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe3dac0c99affe0d1 expref: 19 pid: 5832 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841678.396444:0:7633:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92cbc149d400/0xe3dac0c99affe0d8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe3dac0c99affe0d1 expref: 19 pid: 5832 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841678.396454:0:7633:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787841678.396475:0:7633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e64f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:3300:x1874687714952576:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841678.396480:0:7633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787841678.396528:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4a9cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3299:1874687714952320:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787841678.396559:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbcd4492c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3300:1874687714952576:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787841678.396567:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbcd44ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3300:1874687714952448:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787841678.396711:0:8503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92cbc6724000/0xe3dac0c99affe1b1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe3dac0c99affe1aa expref: 18 pid: 5831 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841678.396726:0:8503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf04c2580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8503:1874687714951936:0@lo:104: 00010000:00010000:0.0:1787841678.396738:0:8503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92cbc169b600/0xe3dac0c99affe14f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe3dac0c99affe148 expref: 17 pid: 5833 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841678.396747:0:8503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf04c2d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8503:1874687714952064:0@lo:104: 00010000:00010000:0.0:1787841678.396757:0:8503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92cbc149d400/0xe3dac0c99affe0d8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe3dac0c99affe0d1 expref: 16 pid: 5832 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841678.396779:0:8503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf04c12c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8503:1874687714952192:0@lo:104: 00000100:00100000:1.0:1787841678.415288:0:8503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf04c0b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8503:1874687714951808:192.168.201.1@tcp:104: 00010000:00010000:1.0:1787841678.415336:0:8503:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff92cbc6724800/0xe3dac0c99affe30f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841678.416038:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841678.416609:0:7633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695001344 00000100:00100000:1.0:1787841678.416619:0:7633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695001344 00010000:00010000:1.0:1787841678.416663:0:7633:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92cbc6725c00/0xe3dac0c99affe26e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d66d1 expref: 10 pid: 5832 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841678.416741:0:7633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 24 00000100:00100000:1.0:1787841678.416762:0:7633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbd4bac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09a1f1ce-26b5-4cc6-a1db-8e09063432da+10:2356:x1874687695001344:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787841678.417013:0:7633:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787841678.417021:0:7633:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92cbc6725c00/0xe3dac0c99affe26e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d66d1 expref: 10 pid: 5832 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841678.417034:0:7633:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92cbc6725c00/0xe3dac0c99affe26e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d66d1 expref: 10 pid: 5832 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841678.417056:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92cbc6725c00/0xe3dac0c99affe26e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d66d1 expref: 10 pid: 5832 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841678.417075:0:7633:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff92cbc6724800/0xe3dac0c99affe30f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841678.417083:0:7633:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92cbc6724800/0xe3dac0c99affe30f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841678.417100:0:7633:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92cbc6724800/0xe3dac0c99affe30f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841678.417107:0:7633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92cbc6724800/0xe3dac0c99affe30f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841678.417128:0:7633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff92cbc6724800/0xe3dac0c99affe30f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841678.417135:0:7633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff92cbc6724800/0xe3dac0c99affe30f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841678.417141:0:7633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6724800 already unused, calling callback (ffffffffc17a4500) 00010000:00010000:1.0:1787841678.417145:0:7633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff92cbc6724800/0xe3dac0c99affe30f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841678.417153:0:7633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff92cbc6724800/0xe3dac0c99affe30f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841678.421475:0:8503:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff92cbc6724800/0xe3dac0c99affe30f lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841678.421495:0:8503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff92cbc6724800/0xe3dac0c99affe30f lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841678.423458:0:7633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff92cbc6724800/0xe3dac0c99affe30f lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841678.423476:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92cbc6724800/0xe3dac0c99affe30f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841678.423501:0:7633:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787841678.423593:0:7633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbd4bac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09a1f1ce-26b5-4cc6-a1db-8e09063432da+9:2356:x1874687695001344:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 6820us (8410us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841678.423605:0:7633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 24 00000100:00100000:0.0:1787841678.601418:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787841678.601446:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbcd448780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874687714952704:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787841678.601534:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841678.601780:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714952704 00000100:00100000:2.0:1787841678.601788:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714952704 00000100:00100000:2.0:1787841678.601858:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787841678.601876:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf04c3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874687714952704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787841678.601915:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787841678.601994:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf04c3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874687714952704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 127us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841678.602002:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1787841678.602379:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbcd448780 x1874687714952704/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841694 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787841678.602400:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbcd448780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874687714952704:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787841678.914290:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787841679.572006:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841679.572126:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695001472 00000100:00100000:2.0:1787841679.572137:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695001472 00000100:00100000:2.0:1787841679.572194:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 173 00000100:00100000:2.0:1787841679.572204:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a1f1ce-26b5-4cc6-a1db-8e09063432da+9:5607:x1874687695001472:12345-192.168.201.1@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787841679.572221:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841679.572240:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92cbc6599a00/0xe3dac0c99affe316 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6710 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841679.572269:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92cbc6599a00/0xe3dac0c99affe316 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6710 expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841679.572280:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92cbc6599a00/0xe3dac0c99affe316 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6710 expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841679.572288:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc6599a00, rc 0) 00000100:00100000:2.0:1787841679.572351:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a1f1ce-26b5-4cc6-a1db-8e09063432da+10:5607:x1874687695001472:12345-192.168.201.1@tcp:101:ll_cfg_requeue.0 Request processed in 148us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841679.572358:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 173 00000100:00100000:1.0:1787841679.586468:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841679.586834:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695001600 00000100:00100000:0.0:1787841679.586846:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695001600 00000100:00100000:0.0:1787841679.586897:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 174 00000100:00100000:0.0:1787841679.586908:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a1f1ce-26b5-4cc6-a1db-8e09063432da+10:5607:x1874687695001600:12345-192.168.201.1@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787841679.589212:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a1f1ce-26b5-4cc6-a1db-8e09063432da+10:5607:x1874687695001600:12345-192.168.201.1@tcp:501:ll_cfg_requeue.0 Request processed in 2297us (2740us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841679.589238:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 174 00000100:00100000:0.0:1787841679.593944:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841679.594134:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695001728 00000100:00100000:3.0:1787841679.594177:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695001728 00000100:00100000:3.0:1787841679.594395:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 175 00000100:00100000:3.0:1787841679.594410:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a1f1ce-26b5-4cc6-a1db-8e09063432da+10:5607:x1874687695001728:12345-192.168.201.1@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787841679.594629:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a1f1ce-26b5-4cc6-a1db-8e09063432da+10:5607:x1874687695001728:12345-192.168.201.1@tcp:503:ll_cfg_requeue.0 Request processed in 223us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841679.594637:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 175 00000100:00100000:0.0:1787841679.602940:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841679.603001:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695001856 00000100:00100000:1.0:1787841679.603012:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695001856 00000100:00100000:1.0:1787841679.603076:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 176 00000100:00100000:1.0:1787841679.603087:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a1f1ce-26b5-4cc6-a1db-8e09063432da+10:6138:x1874687695001856:12345-192.168.201.1@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787841679.603361:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a1f1ce-26b5-4cc6-a1db-8e09063432da+10:6138:x1874687695001856:12345-192.168.201.1@tcp:502:llog_process_th.0 Request processed in 274us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841679.603375:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 176 00000100:00100000:1.0:1787841679.613414:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841679.615644:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695001984 00000100:00100000:3.0:1787841679.615659:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695001984 00000100:00100000:3.0:1787841679.615746:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 177 00000100:00100000:3.0:1787841679.615757:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a1f1ce-26b5-4cc6-a1db-8e09063432da+10:6138:x1874687695001984:12345-192.168.201.1@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787841679.616214:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a1f1ce-26b5-4cc6-a1db-8e09063432da+10:6138:x1874687695001984:12345-192.168.201.1@tcp:502:llog_process_th.0 Request processed in 458us (2809us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841679.616222:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 177 00010000:00010000:2.0:1787841679.938918:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787841680.194448:0:5836:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787841680.194457:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92cbff856800 from 4 10000000:01000000:2.0:1787841680.194462:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787841680.194508:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc6598a00/0xe3dac0c99affe31d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841680.194521:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff92cbc6598a00/0xe3dac0c99affe31d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841680.194544:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff92cbc6598a00/0xe3dac0c99affe31d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841680.194572:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbcd449680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714952832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787841680.194692:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841680.195065:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbf0515780 going to sleep for 11 seconds 00000100:00100000:0.0:1787841680.200032:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714952832 00000100:00100000:0.0:1787841680.200046:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714952832 00000100:00100000:1.0:1787841680.200236:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1787841680.200246:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+16:5836:x1874687714952832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787841680.200262:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841680.200396:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92cbc169b600/0xe3dac0c99affe324 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe3dac0c99affe31d expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841680.200428:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92cbc169b600/0xe3dac0c99affe324 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe3dac0c99affe31d expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841680.200441:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92cbc169b600/0xe3dac0c99affe324 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe3dac0c99affe31d expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841680.200450:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc169b600, rc 0) 00000100:00100000:1.0:1787841680.200584:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+17:5836:x1874687714952832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 339us (5892us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841680.200592:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1787841680.204444:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbcd449680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714952832:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787841680.204475:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff92cbc6598a00/0xe3dac0c99affe31d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe324 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841680.204489:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff92cbc6598a00/0xe3dac0c99affe31d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe3dac0c99affe324 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841680.204675:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf04c0780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714952960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787841680.205167:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841680.205217:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbf6ebb240 going to sleep for 11 seconds 00000100:00100000:0.0:1787841680.205246:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714952960 00000100:00100000:0.0:1787841680.205254:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714952960 00000100:00100000:0.0:1787841680.205452:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1787841680.205462:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+17:5836:x1874687714952960:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787841680.205809:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+17:5836:x1874687714952960:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 348us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841680.205818:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1787841680.206440:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf04c0780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714952960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787841680.206492:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e67840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714953088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787841680.206544:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841680.206580:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbff3edb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787841680.206642:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714953088 00000100:00100000:0.0:1787841680.206649:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714953088 00000100:00100000:0.0:1787841680.206692:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1787841680.206729:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+17:5836:x1874687714953088:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787841680.206920:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+17:5836:x1874687714953088:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 203us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841680.206928:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1787841680.207152:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e67840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714953088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787841680.209411:0:8555:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf04c1680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f6e7591a-84a0-4774-9d28-b3ed28591dc5:8555:1874687714953216:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787841680.209507:0:8555:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841680.209546:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714953216 00000100:00100000:0.0:1787841680.209552:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714953216 00000100:00100000:0.0:1787841680.209605:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1787841680.209620:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+17:8555:x1874687714953216:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787841680.209861:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+17:8555:x1874687714953216:12345-0@lo:502:llog_process_th.0 Request processed in 240us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841680.210206:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1787841680.210265:0:8555:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbf6ebb240 going to sleep for 11 seconds 00000100:00100000:0.0:1787841680.210544:0:8555:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf04c1680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f6e7591a-84a0-4774-9d28-b3ed28591dc5:8555:1874687714953216:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787841680.210577:0:8555:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787841680.210587:0:8555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787841680.210590:0:8555:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787841680.210596:0:8555:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff92cbff856800 00000020:00000080:0.0:1787841680.210598:0:8555:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787841680.210745:0:8555:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf04c1680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f6e7591a-84a0-4774-9d28-b3ed28591dc5:8555:1874687714953344:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787841680.210795:0:8555:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841680.210821:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714953344 00000100:00100000:0.0:1787841680.210825:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714953344 00000100:00100000:0.0:1787841680.210856:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1787841680.210864:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+17:8555:x1874687714953344:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787841680.211048:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+17:8555:x1874687714953344:12345-0@lo:502:llog_process_th.0 Request processed in 184us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841680.211056:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1787841680.211095:0:8555:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbcd4bf240 going to sleep for 11 seconds 00000100:00100000:0.0:1787841680.211107:0:8555:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf04c1680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f6e7591a-84a0-4774-9d28-b3ed28591dc5:8555:1874687714953344:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787841680.211125:0:8555:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787841680.211130:0:8555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787841680.211132:0:8555:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1787841680.211135:0:8555:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1787841680.211193:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1787841680.211217:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787841680.211228:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc6598a00/0xe3dac0c99affe31d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe324 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841680.211239:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff92cbc6598a00/0xe3dac0c99affe31d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe324 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787841680.211249:0:5836:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787841680.211252:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92cbf04e3800 from 4 10000000:01000000:0.0:1787841680.211255:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787841680.213413:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc6724400/0xe3dac0c99affe32b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841680.213432:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff92cbc6724400/0xe3dac0c99affe32b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841680.213443:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff92cbc6724400/0xe3dac0c99affe32b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841680.213471:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf04c1680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714953472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787841680.213539:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841680.213610:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714953472 00000100:00100000:0.0:1787841680.213617:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714953472 00000100:00100000:0.0:1787841680.213657:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1787841680.213665:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+17:5836:x1874687714953472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787841680.213678:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841680.213693:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92cbc6725a00/0xe3dac0c99affe332 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe3dac0c99affe32b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841680.214054:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92cbc6725a00/0xe3dac0c99affe332 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe3dac0c99affe32b expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841680.220213:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92cbc6725a00/0xe3dac0c99affe332 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe3dac0c99affe32b expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841680.220225:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc6725a00, rc 0) 00000100:00100000:0.0:1787841680.220320:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+18:5836:x1874687714953472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 6653us (6779us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841680.220329:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1787841680.220395:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbcd4bf240 going to sleep for 11 seconds 00000100:00100000:0.0:1787841680.220416:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf04c1680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714953472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787841680.220437:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff92cbc6724400/0xe3dac0c99affe32b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe332 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841680.220447:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff92cbc6724400/0xe3dac0c99affe32b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe3dac0c99affe332 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841680.220516:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf04c1680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714953600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787841680.220556:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841680.220580:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbcd4bf240 going to sleep for 11 seconds 00000100:00100000:1.0:1787841680.220819:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714953600 00000100:00100000:1.0:1787841680.220825:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714953600 00000100:00100000:1.0:1787841680.220880:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1787841680.220887:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+18:5836:x1874687714953600:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787841680.221132:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+18:5836:x1874687714953600:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 245us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841680.221139:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1787841680.221167:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf04c1680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714953600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787841680.221194:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e65e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714953728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787841680.221226:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841680.221243:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714953728 00000100:00100000:1.0:1787841680.221246:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714953728 00000100:00100000:1.0:1787841680.221264:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1787841680.221269:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+18:5836:x1874687714953728:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787841680.221396:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+18:5836:x1874687714953728:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 126us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841680.221403:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1787841680.221433:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbff3ed480 going to sleep for 11 seconds 00000100:00100000:1.0:1787841680.221442:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e65e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714953728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787841680.221624:0:8556:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e65e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f6e7591a-84a0-4774-9d28-b3ed28591dc5:8556:1874687714953856:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787841680.221658:0:8556:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841680.221673:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714953856 00000100:00100000:1.0:1787841680.221676:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714953856 00000100:00100000:1.0:1787841680.221692:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1787841680.221735:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+18:8556:x1874687714953856:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787841680.221844:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+18:8556:x1874687714953856:12345-0@lo:502:llog_process_th.0 Request processed in 146us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841680.221855:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1787841680.221882:0:8556:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbff3ed780 going to sleep for 11 seconds 00000100:00100000:1.0:1787841680.221892:0:8556:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e65e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f6e7591a-84a0-4774-9d28-b3ed28591dc5:8556:1874687714953856:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787841680.221909:0:8556:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787841680.221917:0:8556:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787841680.221919:0:8556:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787841680.221925:0:8556:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff92cbf04e3800 00000020:00000080:1.0:1787841680.221927:0:8556:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787841680.228623:0:8556:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e65e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f6e7591a-84a0-4774-9d28-b3ed28591dc5:8556:1874687714953984:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787841680.228732:0:8556:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841680.228784:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714953984 00000100:00100000:1.0:1787841680.228790:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714953984 00000100:00100000:1.0:1787841680.228831:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1787841680.228838:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+18:8556:x1874687714953984:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787841680.229176:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+18:8556:x1874687714953984:12345-0@lo:502:llog_process_th.0 Request processed in 337us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841680.229185:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1787841680.229240:0:8556:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbf71bae40 going to sleep for 11 seconds 00000100:00100000:1.0:1787841680.229260:0:8556:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e65e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f6e7591a-84a0-4774-9d28-b3ed28591dc5:8556:1874687714953984:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787841680.229837:0:8556:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787841680.229846:0:8556:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787841680.229849:0:8556:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1787841680.229854:0:8556:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1787841680.230003:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1787841680.230022:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787841680.230033:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc6724400/0xe3dac0c99affe32b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe332 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841680.230052:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff92cbc6724400/0xe3dac0c99affe32b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe332 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787841680.230065:0:5836:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787841680.230067:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92cbc3ed8000 from 4 10000000:01000000:1.0:1787841680.230070:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787841680.230101:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc169ac00/0xe3dac0c99affe339 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841680.230109:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff92cbc169ac00/0xe3dac0c99affe339 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841680.230119:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff92cbc169ac00/0xe3dac0c99affe339 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841680.230138:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e65e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714954112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787841680.230188:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841680.230214:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbff3ed780 going to sleep for 11 seconds 00000100:00100000:0.0:1787841680.230480:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714954112 00000100:00100000:0.0:1787841680.230487:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714954112 00000100:00100000:0.0:1787841680.230520:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1787841680.230527:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+18:5836:x1874687714954112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787841680.230539:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841680.230551:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92cbc6724c00/0xe3dac0c99affe340 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe3dac0c99affe339 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841680.230587:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92cbc6724c00/0xe3dac0c99affe340 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe3dac0c99affe339 expref: 19 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841680.230597:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92cbc6724c00/0xe3dac0c99affe340 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe3dac0c99affe339 expref: 19 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841680.230606:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc6724c00, rc 0) 00000100:00100000:0.0:1787841680.230645:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:5836:x1874687714954112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841680.230651:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1787841680.230689:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e65e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714954112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787841680.232841:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff92cbc169ac00/0xe3dac0c99affe339 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe340 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841680.232861:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff92cbc169ac00/0xe3dac0c99affe339 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe3dac0c99affe340 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841680.233041:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf04c1a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714954240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787841680.233104:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841680.233137:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbcd4bf0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787841680.233165:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714954240 00000100:00100000:0.0:1787841680.233171:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714954240 00000100:00100000:0.0:1787841680.233211:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1787841680.233219:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:5836:x1874687714954240:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787841680.246149:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:5836:x1874687714954240:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 12923us (13037us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841680.246171:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1787841680.246357:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf04c1a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714954240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787841680.246413:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4bacf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714954368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787841680.246465:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841680.246505:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbcd629cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787841680.248473:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714954368 00000100:00100000:0.0:1787841680.248483:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714954368 00000100:00100000:0.0:1787841680.248534:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1787841680.248543:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:5836:x1874687714954368:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787841680.248780:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:5836:x1874687714954368:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 238us (2315us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841680.248787:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1787841680.248858:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4bacf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714954368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787841680.256836:0:8558:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf04c21c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f6e7591a-84a0-4774-9d28-b3ed28591dc5:8558:1874687714954496:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787841680.257150:0:8558:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841680.257576:0:8558:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbcd4bf9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787841680.266604:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714954496 00000100:00100000:3.0:1787841680.266622:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714954496 00000100:00100000:3.0:1787841680.268404:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1787841680.268431:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:8558:x1874687714954496:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787841680.268749:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:8558:x1874687714954496:12345-0@lo:502:llog_process_th.0 Request processed in 330us (11597us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841680.268758:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1787841680.268889:0:8558:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf04c21c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f6e7591a-84a0-4774-9d28-b3ed28591dc5:8558:1874687714954496:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787841680.268921:0:8558:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787841680.268929:0:8558:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787841680.268932:0:8558:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787841680.268949:0:8558:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff92cbc3ed8000 00000020:00000080:1.0:1787841680.268952:0:8558:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787841680.269339:0:8558:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e64000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f6e7591a-84a0-4774-9d28-b3ed28591dc5:8558:1874687714954624:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787841680.269390:0:8558:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841680.292687:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714954624 00000100:00100000:0.0:1787841680.292712:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714954624 00000100:00100000:0.0:1787841680.292775:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1787841680.292784:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe9a1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:8558:x1874687714954624:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787841680.293079:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe9a1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:8558:x1874687714954624:12345-0@lo:502:llog_process_th.0 Request processed in 295us (23688us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841680.293087:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1787841680.294769:0:8558:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbff3ed480 going to sleep for 11 seconds 00000100:00100000:0.0:1787841680.294803:0:8558:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e64000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f6e7591a-84a0-4774-9d28-b3ed28591dc5:8558:1874687714954624:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787841680.294843:0:8558:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787841680.294853:0:8558:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787841680.294855:0:8558:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1787841680.294859:0:8558:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1787841680.308097:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1787841680.308202:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787841680.308217:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc169ac00/0xe3dac0c99affe339 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe340 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841680.308229:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff92cbc169ac00/0xe3dac0c99affe339 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe340 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841680.962059:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787841681.041110:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841681.041145:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841681.043770:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841681.043861:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841681.043911:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695002112 00000100:00100000:3.0:1787841681.043923:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695002112 00000100:00100000:2.0:1787841681.054402:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695002368 00000100:00100000:2.0:1787841681.054419:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695002368 00000100:00100000:2.0:1787841681.054499:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695002496 00000100:00100000:2.0:1787841681.054503:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695002496 00000100:00100000:2.0:1787841681.054526:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 13 00000100:00100000:2.0:1787841681.054536:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbd4bae940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b2767a54-6703-4908-8414-eab6601e2ceb+5:2357:x1874687695002368:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:2.0:1787841681.054629:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbd4bae940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b2767a54-6703-4908-8414-eab6601e2ceb+5:2357:x1874687695002368:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 94us (13482us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841681.054637:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 13 00000100:00100000:2.0:1787841681.054657:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 14 00000100:00100000:2.0:1787841681.054664:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf8e81680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b2767a54-6703-4908-8414-eab6601e2ceb+5:2357:x1874687695002496:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:2.0:1787841681.054690:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf8e81680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b2767a54-6703-4908-8414-eab6601e2ceb+5:2357:x1874687695002496:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 27us (10829us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841681.054750:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 14 00000100:00100000:2.0:1787841681.054774:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695002240 00000100:00100000:2.0:1787841681.054778:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695002240 00000100:00100000:2.0:1787841681.054818:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 31 00000100:00100000:2.0:1787841681.054824:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbd4bacf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+6:2357:x1874687695002240:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:2.0:1787841681.054858:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbd4bacf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+6:2357:x1874687695002240:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 34us (11100us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841681.054865:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 31 00000100:00080000:1.0:1787841681.059077:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787841681.059088:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787841681.059097:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787841681.067105:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 193 00000100:00100000:2.0:1787841681.067118:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe9a19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a1f1ce-26b5-4cc6-a1db-8e09063432da+10:2357:x1874687695002112:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:2.0:1787841681.067206:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe9a19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a1f1ce-26b5-4cc6-a1db-8e09063432da+10:2357:x1874687695002112:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 90us (26104us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841681.067214:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 193 00010000:00010000:2.0:1787841681.985386:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787841682.689808:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4bb2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1874687714955008:0@lo:400:kworker.0 00000100:00100000:3.0:1787841682.689927:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841682.690007:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787841682.690014:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4bb2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874687714954880:0@lo:400:kworker.0 00000100:00100000:3.0:1787841682.690041:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841682.690144:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4bb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874687714955392:0@lo:400:kworker.0 00000100:00100000:3.0:1787841682.690174:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841682.690208:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714955008 00000100:00100000:3.0:1787841682.690214:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714955008 00000100:00100000:3.0:1787841682.690265:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714954880 00000100:00100000:3.0:1787841682.690268:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714954880 00000100:00100000:3.0:1787841682.690622:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787841682.690633:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff40bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874687714955008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787841682.690769:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff40bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874687714955008:12345-0@lo:400:kworker.0 Request processed in 138us (842us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841682.690776:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787841682.690795:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787841682.690801:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff408780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874687714954880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787841682.690829:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff408780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874687714954880:12345-0@lo:400:kworker.0 Request processed in 28us (787us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841682.690835:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:3.0:1787841682.690853:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787841682.691008:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4bb21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687714955136:0@lo:400:kworker.0 00000100:00100000:1.0:1787841682.691055:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841682.691079:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787841682.691085:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4bb0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3298:1874687714954752:0@lo:400:kworker.0 00000100:00100000:1.0:1787841682.691112:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841682.691214:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787841682.691225:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf04c21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874687714955520:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787841682.691255:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841682.692206:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714955392 00000100:00100000:2.0:1787841682.692216:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714955392 00000100:00100000:2.0:1787841682.692278:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714955136 00000100:00100000:2.0:1787841682.692281:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714955136 00000100:00100000:2.0:1787841682.692312:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787841682.692320:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff409680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1874687714955392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841682.692378:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff409680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1874687714955392:12345-0@lo:400:kworker.0 Request processed in 59us (2203us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841682.692384:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787841682.692398:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787841682.692403:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e66940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1874687714955136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841682.692440:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e66940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1874687714955136:12345-0@lo:400:kworker.0 Request processed in 37us (1398us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841682.692446:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787841682.692465:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714955520 00000100:00100000:2.0:1787841682.692467:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714955520 00000100:00100000:2.0:1787841682.692491:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787841682.692497:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf04c1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874687714955520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787841682.692525:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787841682.692556:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf04c1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874687714955520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (1301us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841682.692562:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1787841682.692601:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbf04c21c0 x1874687714955520/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841698 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787841682.692620:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf04c21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874687714955520:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1787841682.695025:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787841682.695035:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787841682.705357:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4bb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1874687714955264:0@lo:400:kworker.0 00000100:00100000:1.0:1787841682.705422:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1787841682.705464:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbd4bb21c0 x1874687714955136/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787841698 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787841682.705478:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4bb21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687714955136:0@lo:400:kworker.0 00000100:00100000:1.0:1787841682.705534:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714954752 00000100:00100000:1.0:1787841682.705540:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714954752 00000100:00100000:1.0:1787841682.705587:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1787841682.705595:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe9a1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:3298:x1874687714954752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841682.705645:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe9a1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:3298:x1874687714954752:12345-0@lo:400:kworker.0 Request processed in 52us (14532us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841682.705652:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1787841682.705723:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4bb0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3298:1874687714954752:0@lo:400:kworker.0 00000100:00100000:0.0:1787841682.706968:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714955264 00000100:00100000:0.0:1787841682.706977:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714955264 00000100:00100000:0.0:1787841682.707061:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787841682.707070:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e64b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1874687714955264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841682.707144:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e64b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1874687714955264:12345-0@lo:400:kworker.0 Request processed in 75us (1721us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841682.707151:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:1.0:1787841682.707663:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787841682.707732:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4bb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1874687714955264:0@lo:400:kworker.0 00000100:00100000:3.0:1787841682.713116:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4bb2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874687714954880:0@lo:400:kworker.0 00010000:00080000:3.0:1787841682.713139:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbd4bb3480 x1874687714955392/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787841698 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787841682.713150:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4bb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874687714955392:0@lo:400:kworker.0 00000100:00100000:3.0:1787841682.713161:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4bb2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1874687714955008:0@lo:400:kworker.0 00010000:00010000:3.0:1787841683.008902:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787841683.713740:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787841683.713783:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbcd449a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874687714955648:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787841683.713855:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841683.713936:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714955648 00000100:00100000:2.0:1787841683.713944:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714955648 00000100:00100000:2.0:1787841683.713991:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787841683.714000:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd44a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874687714955648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787841683.714046:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787841683.714092:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd44a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874687714955648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841683.714100:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:2.0:1787841683.714154:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbcd449a40 x1874687714955648/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841699 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787841683.714180:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbcd449a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874687714955648:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787841684.048273:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841685.062542:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841686.080972:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787841686.163676:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841686.163734:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841686.163760:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841686.163787:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841686.163812:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695002880 00000100:00100000:0.0:1787841686.163821:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695002880 00000100:00100000:0.0:1787841686.163885:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695003008 00000100:00100000:0.0:1787841686.163888:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695003008 00000100:00100000:0.0:1787841686.163905:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 17 00000100:00100000:0.0:1787841686.163913:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf04c1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b2767a54-6703-4908-8414-eab6601e2ceb+5:2357:x1874687695002880:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:0.0:1787841686.163980:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf04c1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b2767a54-6703-4908-8414-eab6601e2ceb+5:2357:x1874687695002880:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 67us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841686.163987:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 17 00000100:00100000:0.0:1787841686.164002:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 18 00000100:00100000:0.0:1787841686.164007:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf04c2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b2767a54-6703-4908-8414-eab6601e2ceb+5:2357:x1874687695003008:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:0.0:1787841686.164042:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf04c2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b2767a54-6703-4908-8414-eab6601e2ceb+5:2357:x1874687695003008:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 35us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841686.164048:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 18 00000100:00100000:0.0:1787841686.164065:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695002752 00000100:00100000:0.0:1787841686.164068:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695002752 00000100:00100000:0.0:1787841686.164092:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 35 00000100:00100000:0.0:1787841686.164097:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf04c0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+6:2357:x1874687695002752:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:0.0:1787841686.164120:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf04c0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+6:2357:x1874687695002752:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 24us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841686.164126:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 35 00000100:00080000:0.0:1787841686.164142:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787841686.164146:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787841686.164148:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787841686.164773:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695002624 00000100:00100000:2.0:1787841686.164778:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695002624 00000100:00100000:2.0:1787841686.164816:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 195 00000100:00100000:2.0:1787841686.164823:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe9a1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a1f1ce-26b5-4cc6-a1db-8e09063432da+10:2357:x1874687695002624:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:2.0:1787841686.164870:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe9a1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a1f1ce-26b5-4cc6-a1db-8e09063432da+10:2357:x1874687695002624:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 47us (1202us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841686.164876:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 195 00010000:00010000:3.0:1787841687.106299:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787841687.811252:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e670c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874687714955776:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787841687.811332:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841687.811417:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714955776 00000100:00100000:1.0:1787841687.811424:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714955776 00000100:00100000:1.0:1787841687.811497:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787841687.811506:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874687714955776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787841687.811542:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787841687.811589:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874687714955776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841687.811596:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1787841687.811620:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787841687.811652:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbf6e670c0 x1874687714955776/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841703 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787841687.811671:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e670c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874687714955776:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787841687.818798:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787841687.818832:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e670c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3301:1874687714955904:0@lo:400:kworker.0 00000100:00100000:1.0:1787841687.818909:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841687.818966:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714955904 00000100:00100000:1.0:1787841687.818973:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714955904 00000100:00100000:1.0:1787841687.819020:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1787841687.819029:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe9a1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:3301:x1874687714955904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841687.819080:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe9a1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:3301:x1874687714955904:12345-0@lo:400:kworker.0 Request processed in 52us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841687.819087:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1787841687.819141:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e670c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3301:1874687714955904:0@lo:400:kworker.0 00000100:00100000:0.0:1787841687.819343:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787841687.819353:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf04c0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874687714956032:0@lo:400:kworker.0 00000100:00100000:0.0:1787841687.819385:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841687.819416:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714956032 00000100:00100000:0.0:1787841687.819419:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714956032 00000100:00100000:0.0:1787841687.819449:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787841687.819455:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf04c12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874687714956032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841687.819491:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf04c12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874687714956032:12345-0@lo:400:kworker.0 Request processed in 36us (106us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841687.819497:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787841687.819525:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf04c0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874687714956032:0@lo:400:kworker.0 00000100:00100000:0.0:1787841687.819585:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf04c2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1874687714956416:0@lo:400:kworker.0 00000100:00100000:0.0:1787841687.819622:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841687.819650:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714956416 00000100:00100000:0.0:1787841687.819653:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714956416 00000100:00100000:0.0:1787841687.819684:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787841687.819690:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf04c03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874687714956416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841687.819761:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf04c03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874687714956416:12345-0@lo:400:kworker.0 Request processed in 71us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841687.819767:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787841687.819794:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf04c2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1874687714956416:0@lo:400:kworker.0 00000100:00100000:0.0:1787841687.819841:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf04c2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874687714956288:0@lo:400:kworker.0 00000100:00100000:0.0:1787841687.819868:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841687.819888:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787841687.819892:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf04c0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1874687714956160:0@lo:400:kworker.0 00000100:00100000:0.0:1787841687.819912:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841687.819937:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714956288 00000100:00100000:0.0:1787841687.819940:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714956288 00000100:00100000:0.0:1787841687.819970:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787841687.819976:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf04c2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1874687714956288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841687.820012:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf04c2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1874687714956288:12345-0@lo:400:kworker.0 Request processed in 36us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841687.820019:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787841687.820034:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714956160 00000100:00100000:0.0:1787841687.820036:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714956160 00000100:00100000:0.0:1787841687.820058:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787841687.820064:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf04c3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874687714956160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841687.820093:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf04c3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874687714956160:12345-0@lo:400:kworker.0 Request processed in 28us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841687.820106:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787841687.820137:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf04c0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1874687714956160:0@lo:400:kworker.0 00010000:00080000:0.0:1787841687.820149:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbf04c2d00 x1874687714956288/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787841703 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787841687.820171:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf04c2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874687714956288:0@lo:400:kworker.0 00000100:00080000:0.0:1787841687.820198:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787841687.820203:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787841688.128996:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787841688.832932:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbcd449a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874687714956544:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787841688.833011:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841688.833201:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714956544 00000100:00100000:2.0:1787841688.833210:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714956544 00000100:00100000:2.0:1787841688.833276:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787841688.833287:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e670c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874687714956544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787841688.833325:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787841688.833376:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e670c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874687714956544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841688.833384:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1787841688.833535:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbcd449a40 x1874687714956544/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841704 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787841688.833577:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbcd449a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874687714956544:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1787841688.992512:0:8803:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg101-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:3.0:1787841689.152874:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841690.177947:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841691.202026:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787841691.292520:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841691.292604:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695003136 00000100:00100000:2.0:1787841691.292615:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695003136 00000100:00100000:2.0:1787841691.292670:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 197 00000100:00100000:2.0:1787841691.292681:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe9a1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a1f1ce-26b5-4cc6-a1db-8e09063432da+10:2354:x1874687695003136:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:2.0:1787841691.292837:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe9a1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a1f1ce-26b5-4cc6-a1db-8e09063432da+10:2354:x1874687695003136:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 157us (2971us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841691.292846:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 197 00000100:00100000:1.0:1787841691.293402:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841691.294461:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841691.294490:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841691.295778:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695003392 00000100:00100000:1.0:1787841691.295790:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695003392 00000100:00100000:2.0:1787841691.295997:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695003264 00000100:00100000:2.0:1787841691.296003:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695003264 00000100:00100000:2.0:1787841691.296045:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 39 00000100:00100000:2.0:1787841691.296055:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e67840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+6:2354:x1874687695003264:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:2.0:1787841691.296131:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e67840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+6:2354:x1874687695003264:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 77us (2730us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841691.296139:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 39 00000100:00100000:1.0:1787841691.296327:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695003520 00000100:00100000:1.0:1787841691.296332:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695003520 00000100:00100000:1.0:1787841691.296353:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 11 00000100:00100000:1.0:1787841691.296360:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e66d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b2767a54-6703-4908-8414-eab6601e2ceb+5:2353:x1874687695003392:12345-192.168.201.1@tcp:9:kworker.0 00000020:00000080:1.0:1787841691.296384:0:6688:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe3dac0c99affe27c 00000100:00080000:1.0:1787841691.296393:0:6688:0:(import.c:65:import_set_state_nolock()) ffff92cbf71ad000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787841691.296429:0:6688:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00080000:0.0:1787841691.297444:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787841691.297451:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787841691.297454:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787841691.299523:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e66d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b2767a54-6703-4908-8414-eab6601e2ceb+2:2353:x1874687695003392:12345-192.168.201.1@tcp:9:kworker.0 Request processed in 3153us (5054us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841691.299537:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 11 00000100:00100000:1.0:1787841691.299573:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 12 00000100:00100000:1.0:1787841691.299586:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e67c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b2767a54-6703-4908-8414-eab6601e2ceb+5:2353:x1874687695003520:12345-192.168.201.1@tcp:9:kworker.0 00000020:00000080:1.0:1787841691.299616:0:6688:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe3dac0c99affe283 00000100:00080000:1.0:1787841691.299628:0:6688:0:(import.c:65:import_set_state_nolock()) ffff92cbf71a8000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787841691.299671:0:6688:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1787841691.300663:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e67c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b2767a54-6703-4908-8414-eab6601e2ceb+2:2353:x1874687695003520:12345-192.168.201.1@tcp:9:kworker.0 Request processed in 1076us (6165us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841691.300674:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 12 00010000:00010000:2.0:1787841691.301025:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841691.301779:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841692.230617:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787841692.929078:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e65a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687714956672:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787841692.929152:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841692.929985:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714956672 00000100:00100000:1.0:1787841692.929996:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714956672 00000100:00100000:1.0:1787841692.930078:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787841692.930086:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff40a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874687714956672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787841692.930124:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787841692.930183:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff40a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874687714956672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (1030us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841692.930190:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1787841692.930215:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787841692.930261:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbf6e65a40 x1874687714956672/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841708 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787841692.930281:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e65a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687714956672:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787841692.931415:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e652c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874687714956928:0@lo:400:kworker.0 00000100:00100000:1.0:1787841692.931471:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841692.931499:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787841692.931504:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e643c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1874687714957056:0@lo:400:kworker.0 00000100:00100000:1.0:1787841692.931535:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841692.931562:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714956928 00000100:00100000:1.0:1787841692.931568:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714956928 00000100:00100000:1.0:1787841692.931600:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714957056 00000100:00100000:1.0:1787841692.931602:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714957056 00000100:00100000:1.0:1787841692.931623:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787841692.931630:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbd4bb2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874687714956928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841692.931673:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbd4bb2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874687714956928:12345-0@lo:400:kworker.0 Request processed in 43us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841692.931680:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787841692.931727:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787841692.931744:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbd4bb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874687714957056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841692.931786:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbd4bb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874687714957056:12345-0@lo:400:kworker.0 Request processed in 53us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841692.931792:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:1.0:1787841692.931811:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787841692.931844:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e643c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1874687714957056:0@lo:400:kworker.0 00000100:00100000:1.0:1787841692.931855:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e652c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874687714956928:0@lo:400:kworker.0 00000100:00100000:0.0:1787841692.932192:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e65a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3299:1874687714956800:0@lo:400:kworker.0 00000100:00100000:0.0:1787841692.932240:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841692.932274:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e66580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1874687714957312:0@lo:400:kworker.0 00000100:00100000:0.0:1787841692.932298:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841692.932318:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787841692.932324:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874687714957184:0@lo:400:kworker.0 00000100:00100000:0.0:1787841692.932347:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841692.932372:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714957184 00000100:00100000:0.0:1787841692.932376:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714957184 00000100:00100000:0.0:1787841692.932413:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787841692.932420:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf04c0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1874687714957184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841692.932453:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf04c0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1874687714957184:12345-0@lo:400:kworker.0 Request processed in 35us (105us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841692.932459:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:0.0:1787841692.932489:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbf6e64000 x1874687714957184/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787841708 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787841692.932507:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874687714957184:0@lo:400:kworker.0 00000100:00080000:0.0:1787841692.932535:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787841692.932543:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714957312 00000100:00100000:0.0:1787841692.932546:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714957312 00000100:00100000:0.0:1787841692.932573:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787841692.932579:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf04c2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1874687714957312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841692.932612:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf04c2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1874687714957312:12345-0@lo:400:kworker.0 Request processed in 33us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841692.932618:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787841692.932642:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e66580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1874687714957312:0@lo:400:kworker.0 00000100:00080000:0.0:1787841692.932658:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787841692.933418:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714956800 00000100:00100000:1.0:1787841692.933426:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714956800 00000100:00100000:1.0:1787841692.933458:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1787841692.933466:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe9a1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:3299:x1874687714956800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841692.933529:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe9a1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:3299:x1874687714956800:12345-0@lo:400:kworker.0 Request processed in 53us (1278us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841692.933536:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1787841692.933758:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e65a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3299:1874687714956800:0@lo:400:kworker.0 00010000:00010000:2.0:1787841693.249204:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787841693.955241:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787841693.955265:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbcd44b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874687714957440:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787841693.955348:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841693.955599:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714957440 00000100:00100000:2.0:1787841693.955608:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714957440 00000100:00100000:2.0:1787841693.955665:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787841693.955675:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff408f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874687714957440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787841693.955751:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787841693.955807:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff408f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874687714957440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 132us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841693.955814:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:3.0:1787841693.955900:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbcd44b840 x1874687714957440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841709 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787841693.955936:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbcd44b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874687714957440:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787841694.281848:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787841694.572829:0:7643:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b2767a54-6703-4908-8414-eab6601e2ceb 00000020:00000080:2.0:1787841694.572840:0:7643:0:(genops.c:885:class_export_put()) final put ffff92cbf71ab000/b2767a54-6703-4908-8414-eab6601e2ceb 00000020:00000080:3.0:1787841694.572947:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff92cbf71ab000/b2767a54-6703-4908-8414-eab6601e2ceb for lustre-OST0001 00000020:00000080:3.0:1787841694.573004:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92cbf71a8000 for lustre-OST0001 00000001:02000400:3.0:1787841694.904236:0:9049:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg101-server.virtnet: executing yml_node 00010000:00010000:2.0:1787841695.300597:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787841696.085928:0:6717:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b2767a54-6703-4908-8414-eab6601e2ceb 00000020:00000080:0.0:1787841696.085939:0:6717:0:(genops.c:885:class_export_put()) final put ffff92cbf71a8800/b2767a54-6703-4908-8414-eab6601e2ceb 00000020:00000080:3.0:1787841696.086149:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff92cbf71a8800/b2767a54-6703-4908-8414-eab6601e2ceb for lustre-OST0000 00000020:00000080:3.0:1787841696.086199:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92cbf71ad000 for lustre-OST0000 00010000:00010000:2.0:1787841696.323961:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787841696.408482:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841696.408536:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841696.408566:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695003776 00000100:00100000:0.0:1787841696.408576:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695003776 00000100:00100000:0.0:1787841696.408636:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 43 00000100:00100000:0.0:1787841696.408647:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf04c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2767a54-6703-4908-8414-eab6601e2ceb+6:2354:x1874687695003776:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:0.0:1787841696.408760:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf04c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2767a54-6703-4908-8414-eab6601e2ceb+6:2354:x1874687695003776:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 114us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841696.408768:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 43 00000100:00080000:0.0:1787841696.408791:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787841696.411936:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695003648 00000100:00100000:2.0:1787841696.411952:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695003648 00000100:00100000:2.0:1787841696.412012:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 199 00000100:00100000:2.0:1787841696.412023:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe9a19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a1f1ce-26b5-4cc6-a1db-8e09063432da+10:2354:x1874687695003648:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:2.0:1787841696.412108:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe9a19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a1f1ce-26b5-4cc6-a1db-8e09063432da+10:2354:x1874687695003648:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 87us (3635us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841696.412116:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 199 00010000:00010000:2.0:1787841697.347170:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787841698.049415:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf04c1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874687714957824:0@lo:400:kworker.0 00000100:00100000:0.0:1787841698.049491:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841698.049547:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf04c6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874687714958336:0@lo:400:kworker.0 00000100:00100000:0.0:1787841698.049569:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841698.049594:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787841698.049599:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf04c0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3299:1874687714957696:0@lo:400:kworker.0 00000100:00100000:0.0:1787841698.049620:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841698.049637:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf04c43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1874687714958208:0@lo:400:kworker.0 00000100:00100000:0.0:1787841698.049667:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841698.049693:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714957824 00000100:00100000:0.0:1787841698.049719:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714957824 00000100:00100000:0.0:1787841698.049757:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714958208 00000100:00100000:0.0:1787841698.049760:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714958208 00000100:00100000:0.0:1787841698.049781:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787841698.049788:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf04c52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874687714957824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841698.049845:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf04c52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874687714957824:12345-0@lo:400:kworker.0 Request processed in 56us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841698.049852:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787841698.049867:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787841698.049872:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf04c4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1874687714958208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841698.049893:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf04c4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1874687714958208:12345-0@lo:400:kworker.0 Request processed in 21us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841698.049898:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787841698.049912:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714957696 00000100:00100000:0.0:1787841698.049915:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714957696 00000100:00100000:0.0:1787841698.049933:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1787841698.049938:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe9a1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:3299:x1874687714957696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841698.049969:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe9a1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:3299:x1874687714957696:12345-0@lo:400:kworker.0 Request processed in 31us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841698.049975:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00080000:0.0:1787841698.050002:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787841698.050023:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf04c0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3299:1874687714957696:0@lo:400:kworker.0 00000100:00100000:0.0:1787841698.050048:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf04c43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1874687714958208:0@lo:400:kworker.0 00000100:00100000:0.0:1787841698.050057:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf04c1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874687714957824:0@lo:400:kworker.0 00000100:00100000:3.0:1787841698.050397:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4bb2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874687714957568:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787841698.050446:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841698.050477:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4bada40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874687714958080:0@lo:400:kworker.0 00000100:00100000:3.0:1787841698.050501:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841698.050522:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787841698.050528:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf04c21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1874687714957952:0@lo:400:kworker.0 00000100:00100000:3.0:1787841698.050550:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841698.050577:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714958336 00000100:00100000:3.0:1787841698.050581:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714958336 00000100:00100000:3.0:1787841698.050618:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714958080 00000100:00100000:3.0:1787841698.050620:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714958080 00000100:00100000:3.0:1787841698.050635:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787841698.050641:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf04c7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1874687714958336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787841698.050693:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf04c7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1874687714958336:12345-0@lo:400:kworker.0 Request processed in 52us (1122us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841698.050734:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787841698.050749:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787841698.050755:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff40b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1874687714958080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787841698.050787:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff40b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1874687714958080:12345-0@lo:400:kworker.0 Request processed in 33us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841698.050815:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:3.0:1787841698.050835:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787841698.050838:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787841698.050857:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbd4bada40 x1874687714958080/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787841714 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787841698.050867:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4bada40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874687714958080:0@lo:400:kworker.0 00000100:00100000:3.0:1787841698.050883:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714957952 00000100:00100000:3.0:1787841698.050886:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714957952 00000100:00100000:3.0:1787841698.050914:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787841698.050920:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff409e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874687714957952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787841698.050953:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff409e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874687714957952:12345-0@lo:400:kworker.0 Request processed in 33us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841698.050959:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:3.0:1787841698.050972:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787841698.050987:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf04c21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1874687714957952:0@lo:400:kworker.0 00000100:00100000:0.0:1787841698.051592:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714957568 00000100:00100000:0.0:1787841698.051598:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714957568 00000100:00100000:0.0:1787841698.051641:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787841698.051647:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff40b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874687714957568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787841698.051690:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787841698.051778:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff40b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874687714957568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 131us (1332us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841698.051784:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:1.0:1787841698.051996:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbf04c6d00 x1874687714958336/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787841714 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787841698.052008:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf04c6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874687714958336:0@lo:400:kworker.0 00010000:00080000:3.0:1787841698.052223:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbd4bb2d00 x1874687714957568/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841714 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787841698.052239:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4bb2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874687714957568:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787841698.370769:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787841699.073884:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbcd448000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874687714958464:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787841699.073971:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841699.074051:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714958464 00000100:00100000:1.0:1787841699.074059:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714958464 00000100:00100000:1.0:1787841699.074107:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787841699.074116:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbd4bb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874687714958464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787841699.074155:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787841699.074213:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbd4bb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874687714958464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841699.074221:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:1.0:1787841699.074284:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbcd448000 x1874687714958464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841715 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787841699.074301:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbcd448000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874687714958464:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787841699.394235:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787841699.922001:0:9241:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.95 00010000:00010000:2.0:1787841700.417852:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841701.444842:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787841701.527666:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841701.527808:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695003904 00000100:00100000:2.0:1787841701.527818:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695003904 00000100:00100000:2.0:1787841701.527861:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 201 00000100:00100000:2.0:1787841701.527869:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe9a19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a1f1ce-26b5-4cc6-a1db-8e09063432da+10:2357:x1874687695003904:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:2.0:1787841701.527945:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe9a19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a1f1ce-26b5-4cc6-a1db-8e09063432da+10:2357:x1874687695003904:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 76us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841701.527952:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 201 00000100:00100000:2.0:1787841701.530099:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841701.530227:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695004032 00000100:00100000:0.0:1787841701.530236:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695004032 00000100:00100000:0.0:1787841701.530363:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 47 00000100:00100000:0.0:1787841701.530374:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd449e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+6:2357:x1874687695004032:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:0.0:1787841701.530452:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd449e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+6:2357:x1874687695004032:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 81us (362us total) trans 0 rc 0/0 00000100:00080000:3.0:1787841701.530454:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787841701.530460:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 47 00010000:00010000:2.0:1787841702.467832:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787841703.168985:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff408000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874687714958592:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787841703.169080:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841703.169287:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714958592 00000100:00100000:3.0:1787841703.169296:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714958592 00000100:00080000:2.0:1787841703.169432:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787841703.169492:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787841703.169504:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf04c43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874687714958592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787841703.169542:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787841703.169616:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf04c43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874687714958592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841703.169631:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1787841703.171054:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbff408000 x1874687714958592/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841719 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787841703.171079:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff408000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874687714958592:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787841703.177434:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf04c5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3298:1874687714958720:0@lo:400:kworker.0 00000100:00100000:0.0:1787841703.177509:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841703.178746:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf04c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1874687714959232:0@lo:400:kworker.0 00000100:00100000:0.0:1787841703.178802:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841703.178843:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787841703.178851:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf04c5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874687714958848:0@lo:400:kworker.0 00000100:00100000:3.0:1787841703.179138:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714959232 00000100:00100000:3.0:1787841703.179145:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714959232 00000100:00100000:3.0:1787841703.179212:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787841703.179222:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf04c7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1874687714959232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787841703.179276:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf04c7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1874687714959232:12345-0@lo:400:kworker.0 Request processed in 56us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841703.179283:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787841703.179405:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841703.179451:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf04c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1874687714959232:0@lo:400:kworker.0 00000100:00100000:0.0:1787841703.179504:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714958720 00000100:00100000:0.0:1787841703.179509:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714958720 00000100:00100000:0.0:1787841703.179540:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1787841703.179547:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe9a18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:3298:x1874687714958720:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787841703.179744:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787841703.179979:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714958848 00000100:00100000:3.0:1787841703.179984:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714958848 00000100:00100000:3.0:1787841703.180008:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787841703.180014:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf04c5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874687714958848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787841703.180055:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf04c5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874687714958848:12345-0@lo:400:kworker.0 Request processed in 41us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841703.180061:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787841703.180136:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe9a18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:3298:x1874687714958720:12345-0@lo:400:kworker.0 Request processed in 589us (2626us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841703.180142:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1787841703.180240:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf04c5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874687714958848:0@lo:400:kworker.0 00000100:00100000:0.0:1787841703.180251:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf04c5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3298:1874687714958720:0@lo:400:kworker.0 00000100:00100000:0.0:1787841703.180276:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf04c61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1874687714958976:0@lo:400:kworker.0 00000100:00100000:0.0:1787841703.180303:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841703.180333:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787841703.180340:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf04c4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874687714959104:0@lo:400:kworker.0 00000100:00100000:2.0:1787841703.180448:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714958976 00000100:00100000:2.0:1787841703.180463:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714958976 00000100:00100000:2.0:1787841703.180498:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787841703.180505:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf04c5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874687714958976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841703.180542:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf04c5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874687714958976:12345-0@lo:400:kworker.0 Request processed in 37us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841703.180548:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:2.0:1787841703.180754:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787841703.182245:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841703.182329:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf04c61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1874687714958976:0@lo:400:kworker.0 00000100:00100000:3.0:1787841703.182442:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714959104 00000100:00100000:3.0:1787841703.182448:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714959104 00000100:00100000:3.0:1787841703.182545:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787841703.182561:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbd4bb21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1874687714959104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787841703.182629:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbd4bb21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1874687714959104:12345-0@lo:400:kworker.0 Request processed in 77us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841703.182636:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:1.0:1787841703.182725:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbf04c4f00 x1874687714959104/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787841719 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787841703.182737:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf04c4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874687714959104:0@lo:400:kworker.0 00000100:00080000:2.0:1787841703.183032:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787841703.506151:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787841703.745650:0:9339:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.95 00000100:00100000:1.0:1787841704.195117:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbcd448b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874687714959360:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787841704.195197:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841704.196175:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714959360 00000100:00100000:2.0:1787841704.196185:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714959360 00000100:00100000:2.0:1787841704.196236:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787841704.196244:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbd4bb0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874687714959360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787841704.196282:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787841704.196467:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbd4bb0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874687714959360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 222us (1269us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841704.196476:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1787841704.196527:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbcd448b40 x1874687714959360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841720 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787841704.196567:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbcd448b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874687714959360:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787841704.514919:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841705.538862:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841706.560969:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787841706.653130:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841706.653196:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841706.653277:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695004288 00000100:00100000:1.0:1787841706.653290:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695004288 00000100:00100000:1.0:1787841706.653378:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 51 00000100:00100000:1.0:1787841706.653389:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf04c5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2767a54-6703-4908-8414-eab6601e2ceb+6:2357:x1874687695004288:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:1.0:1787841706.653483:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf04c5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2767a54-6703-4908-8414-eab6601e2ceb+6:2357:x1874687695004288:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 96us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841706.653492:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 51 00000100:00080000:0.0:1787841706.653728:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787841706.654486:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695004160 00000100:00100000:2.0:1787841706.654496:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695004160 00000100:00100000:2.0:1787841706.654554:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 203 00000100:00100000:2.0:1787841706.654563:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe9a1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a1f1ce-26b5-4cc6-a1db-8e09063432da+10:2357:x1874687695004160:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:2.0:1787841706.654763:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe9a1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a1f1ce-26b5-4cc6-a1db-8e09063432da+10:2357:x1874687695004160:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 200us (1649us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841706.654771:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 203 00010000:00010000:1.0:1787841707.585976:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787841707.864046:0:9437:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.95 00000100:00100000:1.0:1787841708.289994:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf04c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3300:1874687714959488:0@lo:400:kworker.0 00000100:00100000:0.0:1787841708.290038:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf04c70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1874687714959744:0@lo:400:kworker.0 00000100:00100000:1.0:1787841708.290094:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841708.290101:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841708.290175:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf04c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874687714959616:0@lo:400:kworker.0 00000100:00100000:3.0:1787841708.290295:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714959744 00000100:00100000:3.0:1787841708.290308:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714959744 00000100:00100000:3.0:1787841708.290372:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787841708.290393:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf04c4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1874687714959744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841708.291415:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf04c4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1874687714960000:0@lo:400:kworker.0 00000100:00100000:1.0:1787841708.291456:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841708.291512:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714959488 00000100:00100000:1.0:1787841708.291517:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714959488 00000100:00100000:1.0:1787841708.291549:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1787841708.291556:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe9a1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:3300:x1874687714959488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841708.291597:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe9a1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:3300:x1874687714959488:12345-0@lo:400:kworker.0 Request processed in 41us (1504us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841708.291604:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1787841708.291745:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff40a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687714960256:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787841708.291775:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841708.291795:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787841708.291802:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf04c6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687714959872:0@lo:400:kworker.0 00000100:00100000:0.0:1787841708.291822:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787841708.291846:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787841708.291859:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714960256 00000100:00100000:0.0:1787841708.291862:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714960256 00000100:00100000:0.0:1787841708.291892:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787841708.291898:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf04c61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874687714960256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787841708.291926:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787841708.291978:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf04c61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874687714960256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841708.291985:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:0.0:1787841708.291998:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787841708.292025:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbff40a940 x1874687714960256/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841724 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787841708.292043:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff40a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687714960256:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787841708.292507:0:5838:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1787841708.292516:0:5838:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1787841708.292538:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714959872 00000100:00100000:0.0:1787841708.292541:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714959872 00000100:00100000:0.0:1787841708.292575:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787841708.292591:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf04c6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3298:x1874687714959872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841708.292630:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf04c6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3298:x1874687714959872:12345-0@lo:400:kworker.0 Request processed in 40us (807us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841708.292637:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1787841708.292649:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787841708.292667:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf04c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3300:1874687714959488:0@lo:400:kworker.0 00010000:00080000:0.0:1787841708.292691:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbf04c6940 x1874687714959872/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787841724 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787841708.292727:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf04c6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687714959872:0@lo:400:kworker.0 00000100:00100000:0.0:1787841708.292822:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714960000 00000100:00100000:0.0:1787841708.292825:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714960000 00000100:00100000:0.0:1787841708.292845:0:5838:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1787841708.292851:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787841708.292856:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbd4bb2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874687714960000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841708.292887:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbd4bb2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874687714960000:12345-0@lo:400:kworker.0 Request processed in 30us (1430us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841708.292893:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:0.0:1787841708.292903:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787841708.292918:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf04c4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1874687714960000:0@lo:400:kworker.0 00000100:00100000:2.0:1787841708.293722:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841708.293758:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf04c6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874687714960128:0@lo:400:kworker.0 00000100:00100000:2.0:1787841708.293784:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841708.293899:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf04c4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1874687714959744:12345-0@lo:400:kworker.0 Request processed in 3518us (3801us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841708.293907:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787841708.293924:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714959616 00000100:00100000:3.0:1787841708.293928:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714959616 00000100:00100000:3.0:1787841708.293964:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787841708.293971:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd4483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874687714959616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787841708.294008:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd4483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874687714959616:12345-0@lo:400:kworker.0 Request processed in 38us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841708.294015:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787841708.294030:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714960128 00000100:00100000:1.0:1787841708.294035:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714960128 00000100:00100000:1.0:1787841708.294077:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787841708.294084:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd44a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1874687714960128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841708.294119:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd44a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1874687714960128:12345-0@lo:400:kworker.0 Request processed in 37us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841708.294126:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787841708.294283:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf04c70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1874687714959744:0@lo:400:kworker.0 00000100:00100000:2.0:1787841708.294305:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf04c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874687714959616:0@lo:400:kworker.0 00010000:00080000:2.0:1787841708.294315:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbf04c6580 x1874687714960128/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787841724 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787841708.294324:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf04c6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874687714960128:0@lo:400:kworker.0 00010000:00010000:2.0:1787841708.609608:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787841709.313749:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbcd44a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874687714960384:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787841709.313839:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841709.314096:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714960384 00000100:00100000:3.0:1787841709.314105:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714960384 00000100:00100000:3.0:1787841709.314164:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787841709.314172:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e65e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874687714960384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787841709.314208:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787841709.314259:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e65e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874687714960384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841709.314267:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:1.0:1787841709.315030:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbcd44a580 x1874687714960384/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841725 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787841709.315052:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbcd44a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874687714960384:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787841709.633512:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787841710.460218:0:9487:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Thu Aug 27 10:41:48 EDT 2026 00010000:00010000:3.0:1787841710.673329:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841711.682664:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787841711.762832:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841711.762890:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841711.763003:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695004544 00000100:00100000:0.0:1787841711.763014:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695004544 00000100:00080000:1.0:1787841711.763094:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787841711.763108:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 55 00000100:00100000:0.0:1787841711.763120:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd448b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+6:2356:x1874687695004544:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:0.0:1787841711.763219:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd448b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+6:2356:x1874687695004544:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 102us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841711.763243:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 55 00000100:00100000:3.0:1787841711.766802:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695004416 00000100:00100000:3.0:1787841711.766819:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695004416 00000100:00100000:3.0:1787841711.766876:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 205 00000100:00100000:3.0:1787841711.766888:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe9a18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a1f1ce-26b5-4cc6-a1db-8e09063432da+10:2356:x1874687695004416:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:3.0:1787841711.766977:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe9a18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a1f1ce-26b5-4cc6-a1db-8e09063432da+10:2356:x1874687695004416:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 91us (4085us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841711.767000:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 205 00010000:00010000:3.0:1787841712.705507:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787841713.412601:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbcd44b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3300:1874687714960512:0@lo:400:kworker.0 00000100:00100000:2.0:1787841713.412726:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841713.412794:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbcd448780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1874687714961024:0@lo:400:kworker.0 00000100:00100000:2.0:1787841713.412825:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841713.412858:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787841713.412864:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbcd44b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874687714960640:0@lo:400:kworker.0 00000100:00100000:3.0:1787841713.412865:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714961024 00000100:00100000:3.0:1787841713.412874:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714961024 00000100:00100000:2.0:1787841713.412886:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841713.412902:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbcd449680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874687714961152:0@lo:400:kworker.0 00000100:00100000:2.0:1787841713.412928:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841713.412937:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714960640 00000100:00100000:3.0:1787841713.412941:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714960640 00000100:00100000:2.0:1787841713.412956:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbcd448f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1874687714960768:0@lo:400:kworker.0 00000100:00100000:3.0:1787841713.412964:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787841713.412974:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd44ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874687714961024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841713.412980:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841713.413002:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff40a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687714961280:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787841713.413038:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd44ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874687714961024:12345-0@lo:400:kworker.0 Request processed in 66us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841713.413041:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841713.413046:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787841713.413061:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787841713.413065:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714960768 00000100:00100000:2.0:1787841713.413066:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbcd449a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687714960896:0@lo:400:kworker.0 00000100:00100000:3.0:1787841713.413067:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714960768 00000100:00100000:3.0:1787841713.413084:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787841713.413088:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841713.413089:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd4492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874687714960640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787841713.413118:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd4492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874687714960640:12345-0@lo:400:kworker.0 Request processed in 28us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841713.413124:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787841713.413133:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787841713.413145:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd44a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1874687714960768:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787841713.413154:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787841713.413183:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd44a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1874687714960768:12345-0@lo:400:kworker.0 Request processed in 44us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841713.413190:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787841713.413208:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714961152 00000100:00100000:3.0:1787841713.413210:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbcd448f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1874687714960768:0@lo:400:kworker.0 00000100:00100000:2.0:1787841713.413211:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714961152 00000100:00100000:2.0:1787841713.413239:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714960896 00000100:00100000:2.0:1787841713.413242:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714960896 00000100:00100000:3.0:1787841713.413246:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787841713.413253:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd44b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1874687714961152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841713.413256:0:6687:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1787841713.413264:0:6687:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1787841713.413290:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd44b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1874687714961152:12345-0@lo:400:kworker.0 Request processed in 36us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841713.413291:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbcd44b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874687714960640:0@lo:400:kworker.0 00000100:00100000:3.0:1787841713.413296:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:2.0:1787841713.413303:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbcd449680 x1874687714961152/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787841729 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787841713.413309:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787841713.413313:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbcd449680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874687714961152:0@lo:400:kworker.0 00000100:00100000:3.0:1787841713.413321:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6ca7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3298:x1874687714960896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841713.413322:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbcd448780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1874687714961024:0@lo:400:kworker.0 00000100:00100000:2.0:1787841713.413343:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714961280 00000100:00100000:2.0:1787841713.413346:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714961280 00000100:00100000:3.0:1787841713.413353:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6ca7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3298:x1874687714960896:12345-0@lo:400:kworker.0 Request processed in 34us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841713.413359:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787841713.413371:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787841713.413377:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6ca7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874687714961280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787841713.413438:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00010000:00080000:3.0:1787841713.413468:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbcd449a40 x1874687714960896/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787841729 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787841713.413477:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6ca7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874687714961280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841713.413478:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbcd449a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687714960896:0@lo:400:kworker.0 00000100:00100000:2.0:1787841713.413483:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:3.0:1787841713.413565:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbff40a580 x1874687714961280/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841729 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787841713.413579:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff40a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687714961280:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1787841713.413600:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787841713.413603:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787841713.414148:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714960512 00000100:00100000:0.0:1787841713.414153:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714960512 00000100:00100000:0.0:1787841713.414193:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1787841713.414202:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe9a18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:3300:x1874687714960512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841713.414261:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe9a18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:3300:x1874687714960512:12345-0@lo:400:kworker.0 Request processed in 61us (1536us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841713.414266:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1787841713.414416:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbcd44b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3300:1874687714960512:0@lo:400:kworker.0 00010000:00010000:2.0:1787841713.731052:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787841714.433070:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787841714.433101:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6ca5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687714961408:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787841714.433188:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841714.433364:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714961408 00000100:00100000:2.0:1787841714.433372:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714961408 00000100:00100000:2.0:1787841714.433437:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787841714.433448:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf04c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874687714961408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787841714.433485:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787841714.433537:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf04c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874687714961408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841714.433545:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:2.0:1787841714.433588:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbf6ca5e00 x1874687714961408/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841730 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787841714.433607:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6ca5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687714961408:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787841714.754665:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841715.777676:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841716.802908:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787841716.882745:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841716.882802:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841716.883009:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695004672 00000100:00100000:0.0:1787841716.883023:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695004672 00000100:00100000:0.0:1787841716.883107:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 207 00000100:00100000:0.0:1787841716.883119:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe9a19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a1f1ce-26b5-4cc6-a1db-8e09063432da+10:2355:x1874687695004672:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:0.0:1787841716.883213:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe9a19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a1f1ce-26b5-4cc6-a1db-8e09063432da+10:2355:x1874687695004672:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 95us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841716.883221:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 207 00000100:00100000:3.0:1787841716.884290:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695004800 00000100:00100000:3.0:1787841716.884302:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695004800 00000100:00100000:3.0:1787841716.884403:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 59 00000100:00100000:3.0:1787841716.884413:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6ca4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+6:2355:x1874687695004800:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:3.0:1787841716.884481:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6ca4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+6:2355:x1874687695004800:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 70us (1801us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841716.884489:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 59 00000100:00080000:0.0:1787841716.884850:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787841717.825948:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787841718.531961:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e643c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1874687714961792:0@lo:400:kworker.0 00000100:00100000:1.0:1787841718.532054:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841718.532122:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787841718.532129:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e66580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687714961920:0@lo:400:kworker.0 00000100:00100000:1.0:1787841718.532157:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841718.532191:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714961792 00000100:00100000:1.0:1787841718.532198:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714961792 00000100:00100000:1.0:1787841718.532252:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787841718.532261:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbd4a9cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1874687714961792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841718.532311:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbd4a9cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1874687714961792:12345-0@lo:400:kworker.0 Request processed in 52us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841718.532318:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787841718.532353:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714961920 00000100:00100000:1.0:1787841718.532357:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714961920 00000100:00100000:1.0:1787841718.532386:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787841718.532393:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff3eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3298:x1874687714961920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841718.532431:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff3eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3298:x1874687714961920:12345-0@lo:400:kworker.0 Request processed in 39us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841718.532438:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1787841718.532454:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787841718.532458:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787841718.532483:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbf6e66580 x1874687714961920/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787841734 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787841718.532496:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e66580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687714961920:0@lo:400:kworker.0 00000100:00100000:1.0:1787841718.532507:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e643c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1874687714961792:0@lo:400:kworker.0 00000100:00100000:2.0:1787841718.532762:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3300:1874687714961536:0@lo:400:kworker.0 00000100:00100000:2.0:1787841718.532796:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841718.532824:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e65a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1874687714962048:0@lo:400:kworker.0 00000100:00100000:2.0:1787841718.532847:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841718.532882:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787841718.532889:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e652c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874687714961664:0@lo:400:kworker.0 00000100:00100000:2.0:1787841718.532912:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841718.532927:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4a9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874687714962176:0@lo:400:kworker.0 00000100:00100000:2.0:1787841718.532949:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841718.532974:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714962176 00000100:00100000:2.0:1787841718.532978:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714962176 00000100:00100000:2.0:1787841718.533008:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787841718.533015:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6ca6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1874687714962176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841718.533053:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6ca6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1874687714962176:12345-0@lo:400:kworker.0 Request processed in 39us (103us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841718.533059:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:2.0:1787841718.533088:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbd4a9f480 x1874687714962176/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787841734 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787841718.533109:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4a9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874687714962176:0@lo:400:kworker.0 00000100:00100000:1.0:1787841718.533248:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714961536 00000100:00100000:1.0:1787841718.533252:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714961536 00000100:00100000:1.0:1787841718.533292:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1787841718.533299:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe9a18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:3300:x1874687714961536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841718.533344:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe9a18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:3300:x1874687714961536:12345-0@lo:400:kworker.0 Request processed in 47us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841718.533350:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1787841718.533375:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714962048 00000100:00100000:1.0:1787841718.533378:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714962048 00000100:00100000:1.0:1787841718.533409:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714961664 00000100:00100000:1.0:1787841718.533412:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714961664 00000100:00100000:1.0:1787841718.533428:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787841718.533435:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6ca6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874687714962048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841718.533464:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6ca6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874687714962048:12345-0@lo:400:kworker.0 Request processed in 30us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841718.533469:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787841718.533480:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787841718.533485:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6ca4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874687714961664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841718.533511:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6ca4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874687714961664:12345-0@lo:400:kworker.0 Request processed in 26us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841718.533517:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:1.0:1787841718.533530:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787841718.533533:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787841718.533548:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e652c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874687714961664:0@lo:400:kworker.0 00000100:00100000:1.0:1787841718.533557:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3300:1874687714961536:0@lo:400:kworker.0 00000100:00100000:1.0:1787841718.533566:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e65a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1874687714962048:0@lo:400:kworker.0 00000100:00100000:3.0:1787841718.537234:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787841718.537258:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf04c4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874687714962304:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787841718.537346:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841718.537471:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714962304 00000100:00100000:0.0:1787841718.537481:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714962304 00000100:00100000:0.0:1787841718.537543:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787841718.537553:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff40a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874687714962304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787841718.537592:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787841718.537638:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff40a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874687714962304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841718.537658:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:3.0:1787841718.538345:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbf04c4b40 x1874687714962304/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841734 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787841718.538366:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf04c4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874687714962304:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787841718.851176:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787841719.554222:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787841719.554245:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf04c6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687714962432:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787841719.554323:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841719.554402:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714962432 00000100:00100000:0.0:1787841719.554409:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714962432 00000100:00100000:0.0:1787841719.554452:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787841719.554461:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf04c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874687714962432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787841719.554495:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787841719.554540:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf04c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874687714962432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841719.554547:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:0.0:1787841719.554589:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbf04c6580 x1874687714962432/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841735 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787841719.554608:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf04c6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687714962432:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787841719.873024:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841720.898857:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841721.921953:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787841722.009112:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841722.009212:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841722.009244:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695005056 00000100:00100000:2.0:1787841722.009254:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695005056 00000100:00100000:2.0:1787841722.009330:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 63 00000100:00100000:2.0:1787841722.009341:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6ca6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+6:2354:x1874687695005056:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:2.0:1787841722.009418:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6ca6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+6:2354:x1874687695005056:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 79us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841722.009426:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 63 00000100:00080000:2.0:1787841722.009466:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787841722.010102:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695004928 00000100:00100000:0.0:1787841722.010108:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695004928 00000100:00100000:0.0:1787841722.010219:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 209 00000100:00100000:0.0:1787841722.010227:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a1f1ce-26b5-4cc6-a1db-8e09063432da+10:2354:x1874687695004928:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:0.0:1787841722.010286:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a1f1ce-26b5-4cc6-a1db-8e09063432da+10:2354:x1874687695004928:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 59us (1182us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841722.010293:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 209 00010000:00010000:0.0:1787841722.944917:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787841723.651112:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf04c6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874687714962560:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787841723.651190:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841723.651794:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff3e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1874687714962944:0@lo:400:kworker.0 00000100:00100000:1.0:1787841723.651841:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841723.651863:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787841723.651869:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff3e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874687714962816:0@lo:400:kworker.0 00000100:00100000:1.0:1787841723.651890:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841723.651917:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714962944 00000100:00100000:1.0:1787841723.651923:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714962944 00000100:00100000:1.0:1787841723.651970:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714962816 00000100:00100000:1.0:1787841723.651972:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714962816 00000100:00100000:1.0:1787841723.651993:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787841723.652001:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff3ea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874687714962944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841723.652065:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff3ea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874687714962944:12345-0@lo:400:kworker.0 Request processed in 64us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841723.652071:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787841723.652090:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787841723.652095:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff3ea940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874687714962816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841723.652123:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff3ea940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874687714962816:12345-0@lo:400:kworker.0 Request processed in 27us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841723.652128:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:1.0:1787841723.652148:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787841723.652180:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff3e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874687714962816:0@lo:400:kworker.0 00000100:00100000:1.0:1787841723.652191:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff3e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1874687714962944:0@lo:400:kworker.0 00000100:00100000:0.0:1787841723.655398:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714962560 00000100:00100000:0.0:1787841723.655414:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714962560 00000100:00100000:0.0:1787841723.655503:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787841723.655512:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf04c4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874687714962560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787841723.655552:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787841723.655628:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf04c4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874687714962560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (4437us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841723.655636:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787841723.655688:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff3eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3301:1874687714962688:0@lo:400:kworker.0 00000100:00100000:0.0:1787841723.655746:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841723.655781:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff3e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1874687714963200:0@lo:400:kworker.0 00000100:00100000:0.0:1787841723.655809:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841723.655832:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787841723.655840:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff3eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874687714963072:0@lo:400:kworker.0 00000100:00100000:0.0:1787841723.655866:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841723.655896:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714962688 00000100:00100000:0.0:1787841723.655900:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714962688 00000100:00100000:0.0:1787841723.655928:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1787841723.655934:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:3301:x1874687714962688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841723.655969:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:3301:x1874687714962688:12345-0@lo:400:kworker.0 Request processed in 35us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841723.655975:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1787841723.656003:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714963072 00000100:00100000:0.0:1787841723.656006:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714963072 00000100:00100000:0.0:1787841723.656049:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787841723.656056:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf04c21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1874687714963072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841723.656089:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf04c21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1874687714963072:12345-0@lo:400:kworker.0 Request processed in 34us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841723.656094:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:0.0:1787841723.656137:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbff3eb840 x1874687714963072/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787841739 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787841723.656149:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff3eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874687714963072:0@lo:400:kworker.0 00000100:00100000:0.0:1787841723.656159:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff3eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3301:1874687714962688:0@lo:400:kworker.0 00010000:00080000:0.0:1787841723.656189:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbf04c6580 x1874687714962560/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841739 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787841723.656204:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf04c6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874687714962560:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787841723.656226:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714963200 00000100:00100000:0.0:1787841723.656229:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714963200 00000100:00100000:0.0:1787841723.656270:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787841723.656277:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf04c6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874687714963200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841723.656318:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf04c6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874687714963200:12345-0@lo:400:kworker.0 Request processed in 42us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841723.656324:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787841723.656350:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff3e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1874687714963200:0@lo:400:kworker.0 00000100:00080000:1.0:1787841723.656546:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787841723.656552:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787841723.656555:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787841723.968880:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787841724.673787:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf04c1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687714963328:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787841724.673867:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841724.674245:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714963328 00000100:00100000:0.0:1787841724.674253:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714963328 00000100:00100000:0.0:1787841724.674312:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787841724.674322:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6ca7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874687714963328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787841724.674386:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787841724.674443:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6ca7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874687714963328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841724.674451:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:2.0:1787841724.674599:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbf04c1e00 x1874687714963328/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841740 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787841724.674619:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf04c1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687714963328:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787841724.992898:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841726.016870:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841727.040847:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787841727.123828:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841727.123872:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841727.123893:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695005184 00000100:00100000:2.0:1787841727.123906:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695005184 00000100:00100000:2.0:1787841727.124232:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 211 00000100:00100000:2.0:1787841727.124243:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a1f1ce-26b5-4cc6-a1db-8e09063432da+10:2357:x1874687695005184:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:2.0:1787841727.124323:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a1f1ce-26b5-4cc6-a1db-8e09063432da+10:2357:x1874687695005184:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 82us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841727.124330:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 211 00000100:00100000:1.0:1787841727.125227:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695005312 00000100:00100000:1.0:1787841727.125236:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695005312 00000100:00100000:1.0:1787841727.125287:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 67 00000100:00100000:1.0:1787841727.125303:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff4083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+6:2357:x1874687695005312:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:1.0:1787841727.125352:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff4083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+6:2357:x1874687695005312:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 50us (1481us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841727.125359:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 67 00000100:00080000:1.0:1787841727.125382:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787841728.067749:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787841728.769310:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf04c0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874687714963456:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787841728.769385:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841728.769480:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714963456 00000100:00100000:1.0:1787841728.769487:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714963456 00000100:00100000:0.0:1787841728.769749:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf04c70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874687714963712:0@lo:400:kworker.0 00000100:00100000:0.0:1787841728.769784:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841728.769813:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787841728.769819:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf04c1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3301:1874687714963584:0@lo:400:kworker.0 00000100:00100000:0.0:1787841728.769846:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841728.769868:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbcd5af840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1874687714964096:0@lo:400:kworker.0 00000100:00100000:0.0:1787841728.769890:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841728.769912:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf04c6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1874687714963840:0@lo:400:kworker.0 00000100:00100000:0.0:1787841728.769935:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841728.769953:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787841728.769971:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbcd5af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687714963968:0@lo:400:kworker.0 00000100:00100000:0.0:1787841728.769997:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841728.770024:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714963712 00000100:00100000:0.0:1787841728.770028:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714963712 00000100:00100000:0.0:1787841728.770064:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714964096 00000100:00100000:0.0:1787841728.770067:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714964096 00000100:00100000:1.0:1787841728.771520:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787841728.771536:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff3e8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874687714963456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787841728.771575:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787841728.771640:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff3e8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874687714963456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (2255us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841728.771657:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787841728.771686:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714963840 00000100:00100000:1.0:1787841728.771692:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714963840 00000100:00100000:0.0:1787841728.775888:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787841728.775907:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd5ade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874687714963712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841728.776729:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787841728.776740:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd5ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874687714964096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841728.776805:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd5ade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874687714963712:12345-0@lo:400:kworker.0 Request processed in 904us (7019us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841728.776812:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787841728.776844:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787841728.776851:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd5af0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1874687714963840:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787841728.777313:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787841728.777319:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787841728.779452:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf04c70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874687714963712:0@lo:400:kworker.0 00000100:00100000:1.0:1787841728.783047:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd5ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874687714964096:12345-0@lo:400:kworker.0 Request processed in 6300us (13146us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841728.783063:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:1.0:1787841728.783140:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbf04c0f00 x1874687714963456/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841744 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787841728.783310:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbcd5af840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1874687714964096:0@lo:400:kworker.0 00000100:00100000:1.0:1787841728.783437:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf04c0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874687714963456:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787841728.793347:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd5af0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1874687714963840:12345-0@lo:400:kworker.0 Request processed in 16487us (23400us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841728.793362:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787841728.793414:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714963584 00000100:00100000:0.0:1787841728.793422:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714963584 00000100:00100000:0.0:1787841728.793468:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1787841728.793477:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:3301:x1874687714963584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841728.793536:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:3301:x1874687714963584:12345-0@lo:400:kworker.0 Request processed in 60us (23688us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841728.793542:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1787841728.793578:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714963968 00000100:00100000:0.0:1787841728.793582:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714963968 00000100:00100000:0.0:1787841728.793622:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787841728.793629:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd5ae940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1874687714963968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841728.793663:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd5ae940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1874687714963968:12345-0@lo:400:kworker.0 Request processed in 35us (23664us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841728.793669:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787841728.793742:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf04c1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3301:1874687714963584:0@lo:400:kworker.0 00000100:00080000:0.0:1787841728.793782:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787841728.793939:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbcd5af480 x1874687714963968/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787841744 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787841728.793953:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbcd5af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687714963968:0@lo:400:kworker.0 00000100:00100000:2.0:1787841728.793977:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf04c6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1874687714963840:0@lo:400:kworker.0 00010000:00010000:3.0:1787841729.105195:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787841729.805431:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787841729.805455:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbcd5acb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874687714964224:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787841729.805531:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841729.808261:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714964224 00000100:00100000:0.0:1787841729.808277:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714964224 00000100:00100000:0.0:1787841729.808338:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787841729.808347:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff4092c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874687714964224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787841729.808387:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787841729.808489:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff4092c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874687714964224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 142us (2957us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841729.808497:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:3.0:1787841729.808726:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbcd5acb40 x1874687714964224/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841745 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787841729.808747:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbcd5acb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874687714964224:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787841730.121439:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841731.140638:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841732.161096:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787841732.247635:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841732.247686:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841732.248167:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695005440 00000100:00100000:2.0:1787841732.248179:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695005440 00000100:00100000:2.0:1787841732.248236:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 213 00000100:00100000:2.0:1787841732.248246:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a1f1ce-26b5-4cc6-a1db-8e09063432da+10:2357:x1874687695005440:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:2.0:1787841732.248330:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a1f1ce-26b5-4cc6-a1db-8e09063432da+10:2357:x1874687695005440:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 86us (708us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841732.248338:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 213 00000100:00100000:1.0:1787841732.250809:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695005568 00000100:00100000:1.0:1787841732.250821:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695005568 00000100:00100000:1.0:1787841732.250927:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 71 00000100:00100000:1.0:1787841732.250937:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd5ae580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+6:2357:x1874687695005568:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:1.0:1787841732.251029:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd5ae580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+6:2357:x1874687695005568:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 93us (3342us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841732.251036:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 71 00000100:00080000:3.0:1787841732.251478:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787841733.186591:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787841733.892167:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff3e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687714964352:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787841733.892252:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841733.892333:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714964352 00000100:00100000:1.0:1787841733.892341:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714964352 00000100:00100000:1.0:1787841733.892403:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787841733.892412:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff3e83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874687714964352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787841733.892450:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787841733.892495:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff3e83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874687714964352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841733.892501:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:1.0:1787841733.892543:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbff3e8780 x1874687714964352/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841749 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787841733.892562:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff3e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687714964352:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787841733.893224:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff3e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687714964864:0@lo:400:kworker.0 00000100:00100000:1.0:1787841733.893261:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841733.893285:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787841733.893291:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff3e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3298:1874687714964480:0@lo:400:kworker.0 00000100:00100000:1.0:1787841733.893318:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841733.893354:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf04c1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1874687714964992:0@lo:400:kworker.0 00000100:00100000:1.0:1787841733.893381:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841733.893408:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff3eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874687714964608:0@lo:400:kworker.0 00000100:00100000:1.0:1787841733.893430:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841733.893447:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787841733.893452:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff3eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1874687714964736:0@lo:400:kworker.0 00000100:00100000:1.0:1787841733.893474:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841733.893501:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714964864 00000100:00100000:1.0:1787841733.893506:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714964864 00000100:00100000:1.0:1787841733.893544:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787841733.893551:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf04c0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3298:x1874687714964864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841733.893591:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf04c0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3298:x1874687714964864:12345-0@lo:400:kworker.0 Request processed in 41us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841733.893599:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787841733.893617:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714964480 00000100:00100000:1.0:1787841733.893620:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714964480 00000100:00100000:1.0:1787841733.893645:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1787841733.893651:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:3298:x1874687714964480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841733.893680:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:3298:x1874687714964480:12345-0@lo:400:kworker.0 Request processed in 29us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841733.893686:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1787841733.893734:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714964992 00000100:00100000:1.0:1787841733.893738:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714964992 00000100:00100000:1.0:1787841733.893762:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714964608 00000100:00100000:1.0:1787841733.893765:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714964608 00000100:00100000:1.0:1787841733.893775:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714964736 00000100:00100000:1.0:1787841733.893778:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714964736 00000100:00100000:1.0:1787841733.893791:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787841733.893805:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e65a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1874687714964992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841733.893836:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e65a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1874687714964992:12345-0@lo:400:kworker.0 Request processed in 32us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841733.893842:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787841733.893855:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787841733.893860:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874687714964608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841733.893905:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874687714964608:12345-0@lo:400:kworker.0 Request processed in 44us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841733.893910:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787841733.893921:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787841733.893927:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e652c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874687714964736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841733.893955:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e652c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874687714964736:12345-0@lo:400:kworker.0 Request processed in 28us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841733.893960:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787841733.893996:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff3e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3298:1874687714964480:0@lo:400:kworker.0 00000100:00100000:1.0:1787841733.894008:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf04c1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1874687714964992:0@lo:400:kworker.0 00010000:00080000:1.0:1787841733.894018:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbff3e8000 x1874687714964864/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787841749 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787841733.894027:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff3e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687714964864:0@lo:400:kworker.0 00000100:00100000:1.0:1787841733.894061:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff3eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1874687714964736:0@lo:400:kworker.0 00000100:00100000:1.0:1787841733.894070:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff3eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874687714964608:0@lo:400:kworker.0 00000100:00080000:3.0:1787841733.894414:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787841733.894420:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787841733.894423:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787841734.217029:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787841734.538228:0:10119:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 10:42:12 (1787841732) === 00000100:00100000:2.0:1787841734.917168:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787841734.917192:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6ca5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874687714965120:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787841734.917268:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841734.917332:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714965120 00000100:00100000:2.0:1787841734.917341:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714965120 00000100:00100000:2.0:1787841734.917390:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787841734.917399:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6ca61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874687714965120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787841734.917437:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787841734.917484:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6ca61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874687714965120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841734.917491:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:2.0:1787841734.917535:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbf6ca5a40 x1874687714965120/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841750 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787841734.917553:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6ca5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874687714965120:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787841735.232993:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787841735.360407:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841735.360814:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695005696 00000100:00100000:2.0:1787841735.360825:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695005696 00000100:00100000:2.0:1787841735.360901:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 215 00000100:00100000:2.0:1787841735.360912:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a1f1ce-26b5-4cc6-a1db-8e09063432da+10:8141:x1874687695005696:12345-192.168.201.1@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787841735.360940:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841735.360973:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92cbc6598800/0xe3dac0c99affe347 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6717 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841735.361004:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92cbc6598800/0xe3dac0c99affe347 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6717 expref: 11 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841735.361017:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92cbc6598800/0xe3dac0c99affe347 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6717 expref: 11 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841735.361027:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc6598800, rc 0) 00000100:00100000:2.0:1787841735.361094:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a1f1ce-26b5-4cc6-a1db-8e09063432da+11:8141:x1874687695005696:12345-192.168.201.1@tcp:101:mount.lustre.0 Request processed in 184us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841735.361112:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 215 00000100:00100000:1.0:1787841735.376668:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841735.376847:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695005824 00000100:00100000:2.0:1787841735.376858:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695005824 00000100:00100000:2.0:1787841735.376922:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 216 00000100:00100000:2.0:1787841735.376933:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a1f1ce-26b5-4cc6-a1db-8e09063432da+11:8141:x1874687695005824:12345-192.168.201.1@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787841735.377335:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a1f1ce-26b5-4cc6-a1db-8e09063432da+11:8141:x1874687695005824:12345-192.168.201.1@tcp:501:mount.lustre.0 Request processed in 402us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841735.377345:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 216 00000100:00100000:3.0:1787841735.387635:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841735.388526:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695005952 00000100:00100000:2.0:1787841735.388539:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695005952 00000100:00100000:2.0:1787841735.388610:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 217 00000100:00100000:2.0:1787841735.388622:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a1f1ce-26b5-4cc6-a1db-8e09063432da+11:8141:x1874687695005952:12345-192.168.201.1@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787841735.388950:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a1f1ce-26b5-4cc6-a1db-8e09063432da+11:8141:x1874687695005952:12345-192.168.201.1@tcp:503:mount.lustre.0 Request processed in 329us (1325us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841735.388959:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 217 00000100:00100000:0.0:1787841735.395787:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841735.396062:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695006080 00000100:00100000:1.0:1787841735.396085:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695006080 00000100:00100000:1.0:1787841735.396156:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 218 00000100:00100000:1.0:1787841735.396165:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a1f1ce-26b5-4cc6-a1db-8e09063432da+11:8144:x1874687695006080:12345-192.168.201.1@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787841735.396455:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a1f1ce-26b5-4cc6-a1db-8e09063432da+11:8144:x1874687695006080:12345-192.168.201.1@tcp:502:llog_process_th.0 Request processed in 290us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841735.396464:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 218 00000100:00100000:3.0:1787841735.453817:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841735.454169:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695006208 00000100:00100000:1.0:1787841735.454180:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695006208 00000100:00100000:1.0:1787841735.454241:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 219 00000100:00100000:1.0:1787841735.454252:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a1f1ce-26b5-4cc6-a1db-8e09063432da+11:8144:x1874687695006208:12345-192.168.201.1@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787841735.454883:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a1f1ce-26b5-4cc6-a1db-8e09063432da+11:8144:x1874687695006208:12345-192.168.201.1@tcp:502:llog_process_th.0 Request processed in 632us (1075us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841735.454891:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 219 00000100:00100000:3.0:1787841735.466578:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841735.466724:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695006336 00000100:00100000:2.0:1787841735.466733:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695006336 00000100:00100000:2.0:1787841735.466788:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 220 00000100:00100000:2.0:1787841735.466797:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a1f1ce-26b5-4cc6-a1db-8e09063432da+11:8141:x1874687695006336:12345-192.168.201.1@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787841735.466815:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841735.466838:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92cbc6598000/0xe3dac0c99affe34e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6741 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841735.466865:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92cbc6598000/0xe3dac0c99affe34e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6741 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841735.466877:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92cbc6598000/0xe3dac0c99affe34e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6741 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841735.466886:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc6598000, rc 0) 00000100:00100000:2.0:1787841735.466962:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a1f1ce-26b5-4cc6-a1db-8e09063432da+12:8141:x1874687695006336:12345-192.168.201.1@tcp:101:mount.lustre.0 Request processed in 166us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841735.466969:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 220 00000100:00100000:0.0:1787841735.485500:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841735.485600:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695006464 00000100:00100000:1.0:1787841735.485612:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695006464 00000100:00100000:1.0:1787841735.485674:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 221 00000100:00100000:1.0:1787841735.485685:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a1f1ce-26b5-4cc6-a1db-8e09063432da+12:8141:x1874687695006464:12345-192.168.201.1@tcp:256:mount.lustre.0 20000000:01000000:1.0:1787841735.485745:0:5832:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787841735.485769:0:5832:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787841735.485774:0:5832:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787841735.485777:0:5832:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787841735.485779:0:5832:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1787841735.494675:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a1f1ce-26b5-4cc6-a1db-8e09063432da+12:8141:x1874687695006464:12345-192.168.201.1@tcp:256:mount.lustre.0 Request processed in 8981us (9173us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841735.494692:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 221 00000100:00100000:3.0:1787841735.503753:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841735.503862:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695006592 00000100:00100000:1.0:1787841735.503884:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695006592 00000100:00100000:1.0:1787841735.503955:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 222 00000100:00100000:1.0:1787841735.503965:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a1f1ce-26b5-4cc6-a1db-8e09063432da+12:8141:x1874687695006592:12345-192.168.201.1@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787841735.504000:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841735.504019:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92cbc169a200/0xe3dac0c99affe355 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6748 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841735.504641:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92cbc169a200/0xe3dac0c99affe355 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6748 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841735.504656:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92cbc169a200/0xe3dac0c99affe355 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6748 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841735.504665:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc169a200, rc 0) 00000100:00100000:1.0:1787841735.504756:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a1f1ce-26b5-4cc6-a1db-8e09063432da+13:8141:x1874687695006592:12345-192.168.201.1@tcp:101:mount.lustre.0 Request processed in 792us (1013us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841735.504764:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 222 00000100:00100000:0.0:1787841735.510621:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841735.510722:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695006720 00000100:00100000:2.0:1787841735.510732:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695006720 00000100:00100000:2.0:1787841735.510789:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 223 00000100:00100000:2.0:1787841735.510798:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a1f1ce-26b5-4cc6-a1db-8e09063432da+13:8141:x1874687695006720:12345-192.168.201.1@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787841735.511563:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a1f1ce-26b5-4cc6-a1db-8e09063432da+13:8141:x1874687695006720:12345-192.168.201.1@tcp:501:mount.lustre.0 Request processed in 764us (950us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841735.511582:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 223 00000100:00100000:3.0:1787841735.516624:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841735.516773:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695006848 00000100:00100000:2.0:1787841735.516784:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695006848 00000100:00100000:2.0:1787841735.516852:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 224 00000100:00100000:2.0:1787841735.516863:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a1f1ce-26b5-4cc6-a1db-8e09063432da+13:8141:x1874687695006848:12345-192.168.201.1@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787841735.517430:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a1f1ce-26b5-4cc6-a1db-8e09063432da+13:8141:x1874687695006848:12345-192.168.201.1@tcp:503:mount.lustre.0 Request processed in 568us (814us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841735.517439:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 224 00000100:00100000:2.0:1787841735.525493:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841735.525588:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695006976 00000100:00100000:1.0:1787841735.525598:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695006976 00000100:00100000:1.0:1787841735.525673:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 225 00000100:00100000:1.0:1787841735.525683:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a1f1ce-26b5-4cc6-a1db-8e09063432da+13:8147:x1874687695006976:12345-192.168.201.1@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787841735.526057:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a1f1ce-26b5-4cc6-a1db-8e09063432da+13:8147:x1874687695006976:12345-192.168.201.1@tcp:502:llog_process_th.0 Request processed in 367us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841735.526066:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 225 00000100:00100000:0.0:1787841735.529806:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841735.529951:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695007104 00000100:00100000:2.0:1787841735.529960:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695007104 00000100:00100000:2.0:1787841735.530019:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 226 00000100:00100000:2.0:1787841735.530028:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a1f1ce-26b5-4cc6-a1db-8e09063432da+13:8147:x1874687695007104:12345-192.168.201.1@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787841735.530486:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a1f1ce-26b5-4cc6-a1db-8e09063432da+13:8147:x1874687695007104:12345-192.168.201.1@tcp:502:llog_process_th.0 Request processed in 458us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841735.530496:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 226 00000100:00100000:3.0:1787841735.534841:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841735.534890:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841735.536678:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695007232 00000100:00100000:1.0:1787841735.536691:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695007232 00000100:00100000:1.0:1787841735.536798:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695007616 00000100:00100000:1.0:1787841735.536802:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695007616 00000100:00100000:0.0:1787841735.538821:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 10 00000100:00100000:0.0:1787841735.538845:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff40ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2353:x1874687695007232:12345-192.168.201.1@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787841735.538891:0:5837:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from fe7d2185-ae43-428e-8bfa-909f60138853@192.168.201.1@tcp t0 exp 0000000000000000 cur 275 last 0 00000100:00100000:1.0:1787841735.540146:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 75 00000100:00100000:1.0:1787841735.540161:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff408b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+6:2357:x1874687695007616:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:1.0:1787841735.540264:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff408b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+6:2357:x1874687695007616:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 107us (5373us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841735.540273:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 75 00000020:00000080:0.0:1787841735.542865:0:5837:0:(genops.c:1385:class_connect()) connect: client fe7d2185-ae43-428e-8bfa-909f60138853, cookie 0xe3dac0c99affe35c 00000004:00100000:0.0:1787841735.542925:0:5837:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1787841735.543259:0:5837:0:(import.c:65:import_set_state_nolock()) ffff92cbf71c3800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787841735.543323:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff40ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fe7d2185-ae43-428e-8bfa-909f60138853+6:2353:x1874687695007232:12345-192.168.201.1@tcp:38:mount.lustre.0 Request processed in 4477us (8496us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841735.543333:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 10 00000100:00080000:2.0:1787841735.550588:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787841735.563511:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841735.563606:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841735.564317:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695007360 00000100:00100000:1.0:1787841735.564327:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695007360 00000100:00100000:1.0:1787841735.564395:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695007488 00000100:00100000:1.0:1787841735.564398:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695007488 00000100:00100000:1.0:1787841735.564417:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 11 00000100:00100000:1.0:1787841735.564427:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6ca5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fe7d2185-ae43-428e-8bfa-909f60138853+7:0:x1874687695007360:12345-192.168.201.1@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787841735.564471:0:5839:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787841735.564601:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6ca5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fe7d2185-ae43-428e-8bfa-909f60138853+7:0:x1874687695007360:12345-192.168.201.1@tcp:41:mount.lustre.0 Request processed in 175us (1099us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841735.564609:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 11 00000100:00100000:1.0:1787841735.564627:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 12 00000100:00100000:1.0:1787841735.564634:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6ca4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fe7d2185-ae43-428e-8bfa-909f60138853+6:8141:x1874687695007488:12345-192.168.201.1@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787841735.564646:0:5839:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787841735.564667:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6ca4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fe7d2185-ae43-428e-8bfa-909f60138853+6:8141:x1874687695007488:12345-192.168.201.1@tcp:41:mount.lustre.0 Request processed in 34us (1062us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841735.564674:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 12 00000100:00080000:2.0:1787841735.565467:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787841735.573394:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841735.573540:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695007744 00000100:00100000:1.0:1787841735.573550:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695007744 00000100:00100000:1.0:1787841735.573612:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 13 00000100:00100000:1.0:1787841735.573624:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd5ac3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fe7d2185-ae43-428e-8bfa-909f60138853+6:8141:x1874687695007744:12345-192.168.201.1@tcp:40:mount.lustre.0 00000100:00100000:1.0:1787841735.573762:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd5ac3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fe7d2185-ae43-428e-8bfa-909f60138853+6:8141:x1874687695007744:12345-192.168.201.1@tcp:40:mount.lustre.0 Request processed in 138us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841735.573787:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 13 00000100:00100000:3.0:1787841735.583645:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841735.583735:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841735.583762:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841735.584299:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695007872 00000100:00100000:0.0:1787841735.584310:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695007872 00000100:00100000:0.0:1787841735.584356:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695008000 00000100:00100000:0.0:1787841735.584359:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695008000 00000100:00100000:0.0:1787841735.584378:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 13 00000100:00100000:0.0:1787841735.584385:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff40b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2353:x1874687695007872:12345-192.168.201.1@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787841735.584418:0:6687:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from fe7d2185-ae43-428e-8bfa-909f60138853@192.168.201.1@tcp t0 exp 0000000000000000 cur 275 last 0 00000020:00000080:0.0:1787841735.584465:0:6687:0:(genops.c:1385:class_connect()) connect: client fe7d2185-ae43-428e-8bfa-909f60138853, cookie 0xe3dac0c99affe363 00002000:00100000:0.0:1787841735.584478:0:6687:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli fe7d2185-ae43-428e-8bfa-909f60138853/ffff92cbf71c0800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211395f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787841735.584490:0:6687:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787841735.584737:0:6687:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787841735.584769:0:6687:0:(import.c:65:import_set_state_nolock()) ffff92cbf71c5000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787841735.584945:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 14 00000100:00100000:3.0:1787841735.584952:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff408000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2353:x1874687695008000:12345-192.168.201.1@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787841735.584971:0:6688:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from fe7d2185-ae43-428e-8bfa-909f60138853@192.168.201.1@tcp t0 exp 0000000000000000 cur 275 last 0 00000020:00000080:3.0:1787841735.584988:0:6688:0:(genops.c:1385:class_connect()) connect: client fe7d2185-ae43-428e-8bfa-909f60138853, cookie 0xe3dac0c99affe36a 00002000:00100000:3.0:1787841735.584994:0:6688:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli fe7d2185-ae43-428e-8bfa-909f60138853/ffff92cc01d36800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211395f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787841735.585011:0:6688:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787841735.585185:0:6688:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787841735.585203:0:6688:0:(import.c:65:import_set_state_nolock()) ffff92cc01d33800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787841735.585239:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff408000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fe7d2185-ae43-428e-8bfa-909f60138853+6:2353:x1874687695008000:12345-192.168.201.1@tcp:8:mount.lustre.0 Request processed in 285us (1475us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841735.585248:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 14 00000100:00100000:0.0:1787841735.585506:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff40b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fe7d2185-ae43-428e-8bfa-909f60138853+6:2353:x1874687695007872:12345-192.168.201.1@tcp:8:mount.lustre.0 Request processed in 1118us (1807us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841735.585514:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 13 00000100:00100000:1.0:1787841735.586728:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695008128 00000100:00100000:1.0:1787841735.586737:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695008128 00000100:00100000:1.0:1787841735.586787:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 1 00000100:00100000:1.0:1787841735.586796:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff40a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fe7d2185-ae43-428e-8bfa-909f60138853+6:8141:x1874687695008128:12345-192.168.201.1@tcp:33:mount.lustre.0 00000004:00200000:1.0:1787841735.587373:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:1.0:1787841735.587509:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff40a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fe7d2185-ae43-428e-8bfa-909f60138853+6:8141:x1874687695008128:12345-192.168.201.1@tcp:33:mount.lustre.0 Request processed in 713us (3874us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841735.587518:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 1 00000001:00100000:3.0:1787841736.062447:0:5860:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of fe7d2185-ae43-428e-8bfa-909f60138853 00010000:00010000:3.0:1787841736.256912:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787841737.096223:0:6717:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fe7d2185-ae43-428e-8bfa-909f60138853 00010000:00010000:3.0:1787841737.281860:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841738.311816:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787841739.010502:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e643c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874687714965248:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787841739.010585:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841739.010663:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714965248 00000100:00100000:1.0:1787841739.010671:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714965248 00000100:00100000:1.0:1787841739.010751:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787841739.010761:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e66580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874687714965248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787841739.011274:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787841739.011334:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e66580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874687714965248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 574us (748us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841739.011341:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:1.0:1787841739.011368:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787841739.011560:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbcd448000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874687714965504:0@lo:400:kworker.0 00000100:00100000:3.0:1787841739.011595:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841739.011620:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787841739.011626:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff409a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3299:1874687714965376:0@lo:400:kworker.0 00000100:00100000:3.0:1787841739.011656:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841739.011676:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbcd448780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1874687714965888:0@lo:400:kworker.0 00000100:00100000:3.0:1787841739.011718:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841739.011758:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714965504 00000100:00100000:3.0:1787841739.011762:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714965504 00000100:00100000:3.0:1787841739.011799:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714965888 00000100:00100000:3.0:1787841739.011802:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714965888 00000100:00100000:3.0:1787841739.011825:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787841739.011832:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd449680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874687714965504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787841739.011872:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd449680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874687714965504:12345-0@lo:400:kworker.0 Request processed in 40us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841739.011879:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787841739.011892:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787841739.011898:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd44b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1874687714965888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787841739.011926:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd44b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1874687714965888:12345-0@lo:400:kworker.0 Request processed in 27us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841739.011931:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787841739.011979:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbcd448780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1874687714965888:0@lo:400:kworker.0 00000100:00100000:3.0:1787841739.012002:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbcd448000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874687714965504:0@lo:400:kworker.0 00000100:00100000:0.0:1787841739.012573:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbcd449a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874687714965760:0@lo:400:kworker.0 00000100:00100000:0.0:1787841739.012611:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787841739.012645:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbf6e643c0 x1874687714965248/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841755 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787841739.012663:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e643c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874687714965248:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787841739.012681:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787841739.012687:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbcd44b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1874687714965632:0@lo:400:kworker.0 00000100:00100000:0.0:1787841739.012741:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841739.012783:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714965632 00000100:00100000:0.0:1787841739.012787:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714965632 00000100:00100000:0.0:1787841739.012824:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787841739.012832:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd5ada40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874687714965632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841739.012871:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd5ada40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874687714965632:12345-0@lo:400:kworker.0 Request processed in 39us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841739.012878:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787841739.013328:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714965760 00000100:00100000:3.0:1787841739.013334:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714965760 00000100:00100000:3.0:1787841739.013372:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787841739.013379:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd5ad680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1874687714965760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787841739.013414:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd5ad680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1874687714965760:12345-0@lo:400:kworker.0 Request processed in 36us (803us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841739.013421:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787841739.014640:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714965376 00000100:00100000:1.0:1787841739.014647:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714965376 00000100:00100000:1.0:1787841739.014809:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1787841739.014819:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:3299:x1874687714965376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841739.014884:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:3299:x1874687714965376:12345-0@lo:400:kworker.0 Request processed in 67us (3227us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841739.014898:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00080000:1.0:1787841739.014939:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787841739.014945:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787841739.014975:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff409a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3299:1874687714965376:0@lo:400:kworker.0 00000100:00100000:1.0:1787841739.019260:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbcd44b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1874687714965632:0@lo:400:kworker.0 00010000:00080000:1.0:1787841739.019282:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbcd449a40 x1874687714965760/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787841755 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787841739.019293:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbcd449a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874687714965760:0@lo:400:kworker.0 00010000:00010000:3.0:1787841739.330571:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787841740.047861:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787841740.047894:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbcd5ac780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687714966016:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787841740.047965:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841740.048048:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714966016 00000100:00100000:0.0:1787841740.048056:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714966016 00000100:00100000:0.0:1787841740.048112:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787841740.048121:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd5ae1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874687714966016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787841740.048158:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787841740.048284:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd5ae1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874687714966016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 163us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841740.048293:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:2.0:1787841740.048331:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbcd5ac780 x1874687714966016/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841756 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787841740.048352:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbcd5ac780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687714966016:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787841740.353521:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787841740.625510:0:7643:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of fe7d2185-ae43-428e-8bfa-909f60138853 00000100:00100000:3.0:1787841740.956241:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841740.956291:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841740.956335:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841740.956374:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841740.956400:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841740.956427:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695008256 00000100:00100000:3.0:1787841740.956437:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695008256 00000100:00100000:3.0:1787841740.956484:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 228 00000100:00100000:3.0:1787841740.956493:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a1f1ce-26b5-4cc6-a1db-8e09063432da+13:2354:x1874687695008256:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:3.0:1787841740.956562:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a1f1ce-26b5-4cc6-a1db-8e09063432da+13:2354:x1874687695008256:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 70us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841740.956570:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 228 00000100:00100000:3.0:1787841740.956602:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695008384 00000100:00100000:3.0:1787841740.956606:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695008384 00000100:00100000:3.0:1787841740.956641:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695008512 00000100:00100000:3.0:1787841740.956644:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695008512 00000100:00100000:3.0:1787841740.956663:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 79 00000100:00100000:3.0:1787841740.956670:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd448000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+6:2355:x1874687695008384:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:3.0:1787841740.956723:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd448000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+6:2355:x1874687695008384:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 29us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841740.956729:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 79 00000100:00100000:3.0:1787841740.956755:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 80 00000100:00100000:3.0:1787841740.956761:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd448f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fe7d2185-ae43-428e-8bfa-909f60138853+5:2354:x1874687695008512:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:3.0:1787841740.956784:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd448f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fe7d2185-ae43-428e-8bfa-909f60138853+5:2354:x1874687695008512:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 24us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841740.956790:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 80 00000100:00100000:3.0:1787841740.956806:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695008640 00000100:00100000:3.0:1787841740.956809:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695008640 00000100:00100000:3.0:1787841740.956830:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695008768 00000100:00100000:3.0:1787841740.956838:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695008768 00000100:00100000:3.0:1787841740.956859:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 34 00000100:00100000:3.0:1787841740.956865:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd448780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fe7d2185-ae43-428e-8bfa-909f60138853+5:2355:x1874687695008640:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:3.0:1787841740.956892:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd448780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fe7d2185-ae43-428e-8bfa-909f60138853+5:2355:x1874687695008640:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 27us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841740.956898:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 34 00000100:00100000:3.0:1787841740.956911:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 35 00000100:00100000:3.0:1787841740.956917:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd449a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fe7d2185-ae43-428e-8bfa-909f60138853+5:2354:x1874687695008768:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:3.0:1787841740.956938:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd449a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fe7d2185-ae43-428e-8bfa-909f60138853+5:2354:x1874687695008768:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 22us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841740.956943:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 35 00000100:00080000:3.0:1787841740.956971:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787841740.956975:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787841740.956978:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787841741.377073:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841742.403336:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841743.425072:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787841744.129980:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4bada40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874687714966272:0@lo:400:kworker.0 00000100:00100000:3.0:1787841744.130052:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841744.130111:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874687714966784:0@lo:400:kworker.0 00000100:00100000:3.0:1787841744.130141:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841744.130177:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787841744.130182:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbcd44b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3301:1874687714966144:0@lo:400:kworker.0 00000100:00100000:3.0:1787841744.130208:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841744.130252:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e28f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1874687714966656:0@lo:400:kworker.0 00000100:00100000:3.0:1787841744.130282:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841744.130330:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e29a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1874687714966400:0@lo:400:kworker.0 00000100:00100000:3.0:1787841744.130361:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841744.130389:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787841744.130397:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e2a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687714966528:0@lo:400:kworker.0 00000100:00100000:3.0:1787841744.130425:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841744.130468:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714966272 00000100:00100000:3.0:1787841744.130474:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714966272 00000100:00100000:3.0:1787841744.130518:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714966656 00000100:00100000:3.0:1787841744.130521:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714966656 00000100:00100000:3.0:1787841744.130540:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714966400 00000100:00100000:3.0:1787841744.130543:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714966400 00000100:00100000:3.0:1787841744.130558:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787841744.130568:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e2b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874687714966272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787841744.132018:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e2b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874687714966272:12345-0@lo:400:kworker.0 Request processed in 1447us (1961us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841744.132029:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787841744.132077:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787841744.132091:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874687714966656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787841744.132148:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874687714966656:12345-0@lo:400:kworker.0 Request processed in 63us (1867us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841744.132156:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787841744.132169:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787841744.132176:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e2b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1874687714966400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787841744.132214:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e2b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1874687714966400:12345-0@lo:400:kworker.0 Request processed in 38us (1854us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841744.132222:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787841744.132253:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714966784 00000100:00100000:3.0:1787841744.132268:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714966784 00000100:00100000:3.0:1787841744.132305:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714966528 00000100:00100000:3.0:1787841744.132308:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714966528 00000100:00100000:3.0:1787841744.132332:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787841744.132338:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e29e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1874687714966784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787841744.132383:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e29e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1874687714966784:12345-0@lo:400:kworker.0 Request processed in 44us (2243us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841744.132392:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787841744.132414:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787841744.132423:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e2a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1874687714966528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787841744.132463:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e2a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1874687714966528:12345-0@lo:400:kworker.0 Request processed in 42us (2038us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841744.132472:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787841744.132501:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714966144 00000100:00100000:3.0:1787841744.132505:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714966144 00000100:00100000:3.0:1787841744.132541:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1787841744.132550:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:3301:x1874687714966144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787841744.132591:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:3301:x1874687714966144:12345-0@lo:400:kworker.0 Request processed in 42us (2380us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841744.132598:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00080000:3.0:1787841744.132655:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787841744.132660:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787841744.132664:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787841744.132748:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbf6e2a1c0 x1874687714966528/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787841760 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787841744.132764:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e2a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687714966528:0@lo:400:kworker.0 00000100:00100000:3.0:1787841744.132795:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e29a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1874687714966400:0@lo:400:kworker.0 00000100:00100000:3.0:1787841744.133202:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbcd44b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3301:1874687714966144:0@lo:400:kworker.0 00000100:00100000:3.0:1787841744.133219:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e28f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1874687714966656:0@lo:400:kworker.0 00000100:00100000:3.0:1787841744.133232:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4bada40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874687714966272:0@lo:400:kworker.0 00010000:00080000:3.0:1787841744.133250:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbf6e2b480 x1874687714966784/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787841760 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787841744.133261:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874687714966784:0@lo:400:kworker.0 00000100:00100000:3.0:1787841744.177241:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787841744.177266:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874687714966912:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787841744.177345:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841744.177397:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714966912 00000100:00100000:3.0:1787841744.177404:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714966912 00000100:00100000:3.0:1787841744.177446:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787841744.177455:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e28f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874687714966912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787841744.177512:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787841744.177553:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e28f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874687714966912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841744.177561:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:3.0:1787841744.177599:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbf6e2b480 x1874687714966912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841760 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787841744.177618:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874687714966912:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787841744.449548:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787841744.749524:0:10319:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg101-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:1.0:1787841745.153186:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787841745.153214:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbcd5acf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687714967040:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787841745.153292:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841745.153415:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714967040 00000100:00100000:2.0:1787841745.153423:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714967040 00000100:00100000:2.0:1787841745.153470:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787841745.153479:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e643c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874687714967040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787841745.153520:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787841745.153575:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e643c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874687714967040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841745.153582:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:1.0:1787841745.153659:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbcd5acf00 x1874687714967040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841761 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787841745.153677:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbcd5acf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687714967040:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787841745.473073:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787841746.072466:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841746.072515:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841746.072572:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841746.072600:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841746.072626:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841746.072645:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695009152 00000100:00100000:3.0:1787841746.072649:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695009408 00000100:00100000:2.0:1787841746.072656:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695009152 00000100:00100000:3.0:1787841746.072669:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695009408 00000100:00100000:2.0:1787841746.072740:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695009024 00000100:00100000:2.0:1787841746.072743:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695009024 00000100:00100000:3.0:1787841746.072744:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695009280 00000100:00100000:3.0:1787841746.072750:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695009280 00000100:00100000:2.0:1787841746.072766:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 84 00000100:00100000:2.0:1787841746.072774:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fe7d2185-ae43-428e-8bfa-909f60138853+5:2357:x1874687695009152:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:3.0:1787841746.072797:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 38 00000100:00100000:3.0:1787841746.072809:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e29a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fe7d2185-ae43-428e-8bfa-909f60138853+5:2357:x1874687695009408:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:3.0:1787841746.072850:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e29a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fe7d2185-ae43-428e-8bfa-909f60138853+5:2357:x1874687695009408:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 43us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841746.072851:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fe7d2185-ae43-428e-8bfa-909f60138853+5:2357:x1874687695009152:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 75us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841746.072867:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 38 00000100:00100000:2.0:1787841746.072868:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 84 00000100:00100000:2.0:1787841746.072900:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 85 00000100:00100000:3.0:1787841746.072910:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 39 00000100:00100000:2.0:1787841746.072910:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e2a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+6:2357:x1874687695009024:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:3.0:1787841746.072926:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e28b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fe7d2185-ae43-428e-8bfa-909f60138853+5:2357:x1874687695009280:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:2.0:1787841746.072937:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e2a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+6:2357:x1874687695009024:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 31us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841746.072942:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 85 00000100:00080000:2.0:1787841746.072969:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787841746.072972:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787841746.072974:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787841746.073567:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e28b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fe7d2185-ae43-428e-8bfa-909f60138853+5:2357:x1874687695009280:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 643us (936us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841746.073575:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 39 00000100:00100000:1.0:1787841746.073991:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695008896 00000100:00100000:1.0:1787841746.073998:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695008896 00000100:00100000:1.0:1787841746.074034:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 230 00000100:00100000:1.0:1787841746.074042:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a1f1ce-26b5-4cc6-a1db-8e09063432da+13:2357:x1874687695008896:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:1.0:1787841746.074102:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a1f1ce-26b5-4cc6-a1db-8e09063432da+13:2357:x1874687695008896:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 60us (1647us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841746.074109:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 230 00010000:00010000:3.0:1787841746.502297:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841747.521354:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841748.547947:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787841749.248943:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874687714967168:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787841749.249067:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841749.249212:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714967168 00000100:00100000:3.0:1787841749.249221:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714967168 00000100:00100000:3.0:1787841749.249294:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787841749.249305:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6ca43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874687714967168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787841749.249365:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787841749.249959:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff409a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3301:1874687714967296:0@lo:400:kworker.0 00000100:00100000:0.0:1787841749.250004:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841749.251800:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6ca43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874687714967168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2484us (2720us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841749.251851:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:3.0:1787841749.251909:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787841749.251938:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714967296 00000100:00100000:3.0:1787841749.251950:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714967296 00000100:00100000:3.0:1787841749.252005:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1787841749.252015:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:3301:x1874687714967296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787841749.252115:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:3301:x1874687714967296:12345-0@lo:400:kworker.0 Request processed in 101us (2110us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841749.252122:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1787841749.252189:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff409a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3301:1874687714967296:0@lo:400:kworker.0 00010000:00080000:0.0:1787841749.252497:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbf6e283c0 x1874687714967168/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841765 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787841749.252524:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874687714967168:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787841749.254394:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff409a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874687714967424:0@lo:400:kworker.0 00000100:00100000:1.0:1787841749.254499:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841749.254544:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787841749.254551:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf04c1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1874687714967552:0@lo:400:kworker.0 00000100:00100000:1.0:1787841749.254576:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841749.254769:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff3eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874687714967680:0@lo:400:kworker.0 00000100:00100000:3.0:1787841749.254812:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841749.254849:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787841749.254855:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff3eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1874687714967808:0@lo:400:kworker.0 00000100:00100000:3.0:1787841749.254879:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841749.254923:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714967680 00000100:00100000:3.0:1787841749.254932:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714967680 00000100:00100000:3.0:1787841749.255007:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787841749.255018:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf8caf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1874687714967680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787841749.255084:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf8caf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1874687714967680:12345-0@lo:400:kworker.0 Request processed in 68us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841749.255093:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787841749.255458:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714967424 00000100:00100000:3.0:1787841749.255465:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714967424 00000100:00100000:3.0:1787841749.255497:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714967552 00000100:00100000:3.0:1787841749.255501:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714967552 00000100:00100000:3.0:1787841749.255531:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714967808 00000100:00100000:3.0:1787841749.255534:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714967808 00000100:00100000:3.0:1787841749.255548:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787841749.255554:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff3e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874687714967424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787841749.255599:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff3e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874687714967424:12345-0@lo:400:kworker.0 Request processed in 45us (1101us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841749.255759:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787841749.255773:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787841749.255780:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff3e8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1874687714967552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787841749.255814:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff3e8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1874687714967552:12345-0@lo:400:kworker.0 Request processed in 34us (1237us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841749.255819:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787841749.255841:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787841749.255847:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e2ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874687714967808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787841749.255873:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e2ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874687714967808:12345-0@lo:400:kworker.0 Request processed in 26us (993us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841749.255879:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:3.0:1787841749.255966:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787841749.255973:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787841749.256012:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff3eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1874687714967808:0@lo:400:kworker.0 00010000:00080000:3.0:1787841749.256029:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbff3eb0c0 x1874687714967680/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787841765 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787841749.256039:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff3eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874687714967680:0@lo:400:kworker.0 00000100:00100000:1.0:1787841749.256190:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf04c1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1874687714967552:0@lo:400:kworker.0 00000100:00100000:1.0:1787841749.256203:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff409a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874687714967424:0@lo:400:kworker.0 00010000:00010000:2.0:1787841749.569938:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787841750.273781:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbcd5ac780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687714967936:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787841750.274036:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841750.274215:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714967936 00000100:00100000:3.0:1787841750.274227:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714967936 00000100:00100000:3.0:1787841750.274303:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787841750.274332:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff3eb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874687714967936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787841750.274383:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787841750.274449:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff3eb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874687714967936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841750.274459:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:1.0:1787841750.274581:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbcd5ac780 x1874687714967936/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841766 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787841750.274606:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbcd5ac780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687714967936:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787841750.593507:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787841751.188867:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841751.188922:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841751.188957:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841751.188981:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841751.189009:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841751.189053:0:9572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695010048 00000100:00100000:2.0:1787841751.189066:0:9572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695010048 00000100:00100000:2.0:1787841751.189147:0:9572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695009920 00000100:00100000:2.0:1787841751.189150:0:9572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695009920 00000100:00100000:2.0:1787841751.189178:0:9572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 41 00000100:00100000:2.0:1787841751.189190:0:9572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6ca6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fe7d2185-ae43-428e-8bfa-909f60138853+5:2356:x1874687695010048:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:2.0:1787841751.189298:0:9572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6ca6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fe7d2185-ae43-428e-8bfa-909f60138853+5:2356:x1874687695010048:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 110us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841751.189307:0:9572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 41 00000100:00100000:2.0:1787841751.189328:0:9572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 42 00000100:00100000:2.0:1787841751.189336:0:9572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6ca4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fe7d2185-ae43-428e-8bfa-909f60138853+5:2356:x1874687695009920:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:2.0:1787841751.189363:0:9572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6ca4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fe7d2185-ae43-428e-8bfa-909f60138853+5:2356:x1874687695009920:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 28us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841751.189370:0:9572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 42 00000100:00100000:2.0:1787841751.189389:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695009792 00000100:00100000:2.0:1787841751.189393:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695009792 00000100:00100000:2.0:1787841751.189419:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695009664 00000100:00100000:2.0:1787841751.189421:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695009664 00000100:00100000:2.0:1787841751.189438:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 89 00000100:00100000:2.0:1787841751.189458:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6ca7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fe7d2185-ae43-428e-8bfa-909f60138853+5:2356:x1874687695009792:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:2.0:1787841751.189491:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6ca7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fe7d2185-ae43-428e-8bfa-909f60138853+5:2356:x1874687695009792:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 34us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841751.189498:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 89 00000100:00100000:2.0:1787841751.189511:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 90 00000100:00100000:2.0:1787841751.189518:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6ca52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+6:2356:x1874687695009664:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:2.0:1787841751.189542:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6ca52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+6:2356:x1874687695009664:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 26us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841751.189548:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 90 00000100:00080000:2.0:1787841751.189569:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787841751.189576:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787841751.189578:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787841751.189817:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695009536 00000100:00100000:0.0:1787841751.189822:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695009536 00000100:00100000:0.0:1787841751.189860:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 232 00000100:00100000:0.0:1787841751.189868:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a1f1ce-26b5-4cc6-a1db-8e09063432da+13:2356:x1874687695009536:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:0.0:1787841751.189901:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a1f1ce-26b5-4cc6-a1db-8e09063432da+13:2356:x1874687695009536:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 35us (1209us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841751.189908:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 232 00010000:00010000:2.0:1787841751.616980:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841752.670375:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841753.675099:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787841754.369167:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff3eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874687714968192:0@lo:400:kworker.0 00000100:00100000:1.0:1787841754.369246:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841754.369302:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf8dc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874687714968704:0@lo:400:kworker.0 00000100:00100000:1.0:1787841754.369329:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841754.369364:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787841754.369371:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff3eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1874687714968320:0@lo:400:kworker.0 00000100:00100000:1.0:1787841754.369394:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841754.369427:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714968192 00000100:00100000:1.0:1787841754.369434:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714968192 00000100:00100000:1.0:1787841754.369479:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714968320 00000100:00100000:1.0:1787841754.369482:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714968320 00000100:00100000:1.0:1787841754.369513:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787841754.369737:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf8dc9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687714968448:0@lo:400:kworker.0 00000100:00100000:0.0:1787841754.369782:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841754.369804:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787841754.369900:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff3ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3298:1874687714968064:0@lo:400:kworker.0 00000100:00100000:0.0:1787841754.369931:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841754.369956:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf8dc9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1874687714968576:0@lo:400:kworker.0 00000100:00100000:0.0:1787841754.369979:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841754.370179:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714968704 00000100:00100000:2.0:1787841754.370185:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714968704 00000100:00100000:2.0:1787841754.370231:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714968448 00000100:00100000:2.0:1787841754.370235:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714968448 00000100:00100000:2.0:1787841754.370260:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787841754.370268:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf8dc9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1874687714968704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841754.370321:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf8dc9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1874687714968704:12345-0@lo:400:kworker.0 Request processed in 54us (991us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841754.370329:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787841754.370346:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787841754.370352:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd5afc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1874687714968448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841754.370387:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd5afc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1874687714968448:12345-0@lo:400:kworker.0 Request processed in 35us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841754.370401:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:2.0:1787841754.370450:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbf8dc9680 x1874687714968448/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787841770 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787841754.370464:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf8dc9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687714968448:0@lo:400:kworker.0 00000100:00100000:1.0:1787841754.370658:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf8dca940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874687714968192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841754.370730:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf8dca940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874687714968192:12345-0@lo:400:kworker.0 Request processed in 1209us (1484us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841754.370738:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787841754.370764:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714968576 00000100:00100000:1.0:1787841754.370767:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714968576 00000100:00100000:1.0:1787841754.370786:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787841754.370791:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf8dca580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874687714968320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841754.370992:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf8dca580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874687714968320:12345-0@lo:400:kworker.0 Request processed in 200us (1597us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841754.370999:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787841754.371011:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787841754.371018:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd5aed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1874687714968576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841754.371093:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd5aed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1874687714968576:12345-0@lo:400:kworker.0 Request processed in 76us (1112us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841754.371099:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:1.0:1787841754.371138:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787841754.371143:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787841754.371145:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787841754.371158:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714968064 00000100:00100000:1.0:1787841754.371162:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714968064 00000100:00100000:1.0:1787841754.371193:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1787841754.371200:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:3298:x1874687714968064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841754.371232:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:3298:x1874687714968064:12345-0@lo:400:kworker.0 Request processed in 32us (1300us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841754.371238:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1787841754.371293:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbcd5acb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874687714968832:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787841754.371333:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841754.371372:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714968832 00000100:00100000:1.0:1787841754.371376:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714968832 00000100:00100000:1.0:1787841754.371403:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787841754.371410:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf8dcb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874687714968832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787841754.371440:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787841754.371475:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf8dcb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874687714968832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841754.371481:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:1.0:1787841754.371510:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbcd5acb40 x1874687714968832/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841770 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787841754.371540:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbcd5acb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874687714968832:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787841754.371569:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff3eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1874687714968320:0@lo:400:kworker.0 00000100:00100000:1.0:1787841754.371581:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff3eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874687714968192:0@lo:400:kworker.0 00010000:00080000:1.0:1787841754.371590:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbf8dc8000 x1874687714968704/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787841770 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787841754.371598:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf8dc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874687714968704:0@lo:400:kworker.0 00000100:00100000:2.0:1787841754.376013:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf8dc9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1874687714968576:0@lo:400:kworker.0 00000100:00100000:2.0:1787841754.376053:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff3ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3298:1874687714968064:0@lo:400:kworker.0 00010000:00010000:3.0:1787841754.692049:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787841755.395646:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787841755.395672:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbcd5af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874687714968960:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787841755.395805:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841755.395955:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714968960 00000100:00100000:0.0:1787841755.395963:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714968960 00000100:00100000:0.0:1787841755.396014:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787841755.396022:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e2a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874687714968960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787841755.396053:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787841755.396093:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e2a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874687714968960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841755.396100:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:3.0:1787841755.396256:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbcd5af480 x1874687714968960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841771 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787841755.396275:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbcd5af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874687714968960:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787841755.714827:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787841756.316080:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841756.316133:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841756.316159:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841756.316195:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841756.316226:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841756.316257:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695010560 00000100:00100000:2.0:1787841756.316267:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695010560 00000100:00100000:2.0:1787841756.316323:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695010688 00000100:00100000:2.0:1787841756.316326:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695010688 00000100:00100000:2.0:1787841756.316353:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 15 00000100:00100000:2.0:1787841756.316363:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6ca70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fe7d2185-ae43-428e-8bfa-909f60138853+5:2353:x1874687695010560:12345-192.168.201.1@tcp:9:kworker.0 00000020:00000080:2.0:1787841756.316396:0:6686:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe3dac0c99affe363 00000100:00080000:2.0:1787841756.316405:0:6686:0:(import.c:65:import_set_state_nolock()) ffff92cbf71c5000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787841756.316446:0:6686:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1787841756.316849:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6ca70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fe7d2185-ae43-428e-8bfa-909f60138853+2:2353:x1874687695010560:12345-192.168.201.1@tcp:9:kworker.0 Request processed in 486us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841756.316857:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 15 00000100:00100000:2.0:1787841756.316875:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 16 00000100:00100000:2.0:1787841756.316883:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf04c7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fe7d2185-ae43-428e-8bfa-909f60138853+5:2353:x1874687695010688:12345-192.168.201.1@tcp:9:kworker.0 00000020:00000080:2.0:1787841756.316908:0:6686:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe3dac0c99affe36a 00000100:00080000:2.0:1787841756.316915:0:6686:0:(import.c:65:import_set_state_nolock()) ffff92cc01d33800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787841756.316935:0:6686:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1787841756.317058:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695010304 00000100:00100000:3.0:1787841756.317064:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695010304 00000100:00100000:3.0:1787841756.317105:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695010432 00000100:00100000:3.0:1787841756.317109:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695010432 00000100:00100000:3.0:1787841756.317143:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 94 00000100:00100000:2.0:1787841756.317165:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf04c7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fe7d2185-ae43-428e-8bfa-909f60138853+2:2353:x1874687695010688:12345-192.168.201.1@tcp:9:kworker.0 Request processed in 279us (933us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841756.317166:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6ca5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+6:2356:x1874687695010304:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:2.0:1787841756.317181:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 16 00010000:00010000:2.0:1787841756.317208:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787841756.317214:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6ca5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+6:2356:x1874687695010304:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 52us (1079us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841756.317223:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 94 00000100:00100000:3.0:1787841756.317238:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 95 00000100:00100000:3.0:1787841756.317247:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6ca5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fe7d2185-ae43-428e-8bfa-909f60138853+5:2357:x1874687695010432:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:3.0:1787841756.317277:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6ca5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fe7d2185-ae43-428e-8bfa-909f60138853+5:2357:x1874687695010432:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 32us (1117us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841756.317291:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 95 00000100:00080000:1.0:1787841756.317341:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787841756.317346:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787841756.317348:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787841756.317358:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787841756.317555:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695010176 00000100:00100000:0.0:1787841756.317560:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695010176 00000100:00100000:0.0:1787841756.317601:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 234 00000100:00100000:0.0:1787841756.317609:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a1f1ce-26b5-4cc6-a1db-8e09063432da+13:2357:x1874687695010176:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:0.0:1787841756.320680:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a1f1ce-26b5-4cc6-a1db-8e09063432da+13:2357:x1874687695010176:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 3055us (4595us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841756.322091:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 234 00010000:00010000:2.0:1787841756.737239:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787841757.567627:0:6717:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fe7d2185-ae43-428e-8bfa-909f60138853 00000020:00000080:3.0:1787841757.567637:0:6717:0:(genops.c:885:class_export_put()) final put ffff92cbf71c0800/fe7d2185-ae43-428e-8bfa-909f60138853 00000020:00000080:1.0:1787841757.577822:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff92cbf71c0800/fe7d2185-ae43-428e-8bfa-909f60138853 for lustre-OST0000 00000020:00000080:1.0:1787841757.577894:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92cbf71c5000 for lustre-OST0000 00010000:00010000:2.0:1787841757.769275:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841758.797434:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787841759.492571:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4a9fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687714969472:0@lo:400:kworker.0 00000100:00100000:2.0:1787841759.492745:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841759.492833:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787841759.492843:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf04c6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3298:1874687714969088:0@lo:400:kworker.0 00000100:00100000:2.0:1787841759.492879:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841759.492905:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4a9f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1874687714969600:0@lo:400:kworker.0 00000100:00100000:2.0:1787841759.492932:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841759.492963:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf04c70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874687714969216:0@lo:400:kworker.0 00000100:00100000:2.0:1787841759.492995:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841759.493020:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4a9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874687714969728:0@lo:400:kworker.0 00000100:00100000:2.0:1787841759.493044:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841759.493065:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787841759.493071:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf04c6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1874687714969344:0@lo:400:kworker.0 00000100:00100000:2.0:1787841759.493108:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841759.493155:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714969472 00000100:00100000:2.0:1787841759.493164:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714969472 00000100:00100000:2.0:1787841759.493244:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714969728 00000100:00100000:2.0:1787841759.493257:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714969728 00000100:00100000:2.0:1787841759.493290:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787841759.493299:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbc9544780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1874687714969472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841759.493365:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbc9544780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1874687714969472:12345-0@lo:400:kworker.0 Request processed in 67us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841759.493374:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787841759.493394:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787841759.493402:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbc95461c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1874687714969728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841759.493435:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbc95461c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1874687714969728:12345-0@lo:400:kworker.0 Request processed in 35us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841759.493441:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787841759.493461:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714969088 00000100:00100000:2.0:1787841759.493465:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714969088 00000100:00100000:2.0:1787841759.493493:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1787841759.493500:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:3298:x1874687714969088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841759.493534:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:3298:x1874687714969088:12345-0@lo:400:kworker.0 Request processed in 35us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841759.493540:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1787841759.493573:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714969600 00000100:00100000:2.0:1787841759.493576:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714969600 00000100:00100000:2.0:1787841759.493604:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714969216 00000100:00100000:2.0:1787841759.493607:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714969216 00000100:00100000:2.0:1787841759.493616:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714969344 00000100:00100000:2.0:1787841759.493618:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714969344 00000100:00100000:2.0:1787841759.493632:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787841759.493638:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbc9545680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1874687714969600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841759.493684:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbc9545680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1874687714969600:12345-0@lo:400:kworker.0 Request processed in 47us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841759.493735:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787841759.493751:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787841759.493758:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbc9545a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874687714969216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841759.493794:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbc9545a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874687714969216:12345-0@lo:400:kworker.0 Request processed in 38us (800us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841759.493801:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787841759.493812:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787841759.493817:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbc9544f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874687714969344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841759.493844:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbc9544f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874687714969344:12345-0@lo:400:kworker.0 Request processed in 27us (736us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841759.493850:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:2.0:1787841759.493883:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787841759.493888:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787841759.493890:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787841759.493943:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf04c6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1874687714969344:0@lo:400:kworker.0 00000100:00100000:2.0:1787841759.493955:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf04c70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874687714969216:0@lo:400:kworker.0 00010000:00080000:2.0:1787841759.493968:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbd4a9f480 x1874687714969728/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787841775 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787841759.493980:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4a9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874687714969728:0@lo:400:kworker.0 00000100:00100000:2.0:1787841759.494025:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf04c6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3298:1874687714969088:0@lo:400:kworker.0 00000100:00100000:2.0:1787841759.494036:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4a9f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1874687714969600:0@lo:400:kworker.0 00010000:00080000:2.0:1787841759.494048:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbd4a9fc00 x1874687714969472/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787841775 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787841759.494072:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4a9fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687714969472:0@lo:400:kworker.0 00000100:00100000:3.0:1787841759.495050:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787841759.495076:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e28780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874687714969856:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787841759.495156:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841759.495219:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714969856 00000100:00100000:3.0:1787841759.495228:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714969856 00000100:00100000:3.0:1787841759.495283:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787841759.495293:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e29680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874687714969856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787841759.495341:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787841759.495393:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e29680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874687714969856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841759.495401:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:3.0:1787841759.495449:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbf6e28780 x1874687714969856/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841775 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787841759.495470:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e28780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874687714969856:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787841759.808866:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787841760.513212:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787841760.513249:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e28780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874687714969984:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787841760.513380:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841760.513569:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714969984 00000100:00100000:3.0:1787841760.513580:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714969984 00000100:00100000:3.0:1787841760.513660:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787841760.513673:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf8dc92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874687714969984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787841760.513770:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787841760.513838:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf8dc92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874687714969984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 157us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841760.513847:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:1.0:1787841760.514200:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbf6e28780 x1874687714969984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841776 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787841760.514223:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e28780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874687714969984:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787841760.832857:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787841761.181015:0:7643:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of fe7d2185-ae43-428e-8bfa-909f60138853 00000020:00000080:0.0:1787841761.181028:0:7643:0:(genops.c:885:class_export_put()) final put ffff92cc01d36800/fe7d2185-ae43-428e-8bfa-909f60138853 00000020:00000080:0.0:1787841761.181072:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff92cc01d36800/fe7d2185-ae43-428e-8bfa-909f60138853 for lustre-OST0001 00000020:00000080:0.0:1787841761.181130:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92cc01d33800 for lustre-OST0001 00000100:00100000:2.0:1787841761.427050:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841761.427118:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841761.427154:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841761.427339:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695010816 00000100:00100000:2.0:1787841761.427355:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695010816 00000100:00100000:2.0:1787841761.427425:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 236 00000100:00100000:2.0:1787841761.427437:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a1f1ce-26b5-4cc6-a1db-8e09063432da+13:2354:x1874687695010816:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:2.0:1787841761.427530:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a1f1ce-26b5-4cc6-a1db-8e09063432da+13:2354:x1874687695010816:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 95us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841761.427538:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 236 00000100:00100000:2.0:1787841761.427582:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695010944 00000100:00100000:2.0:1787841761.427586:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695010944 00000100:00100000:2.0:1787841761.427640:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695011072 00000100:00100000:2.0:1787841761.427644:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695011072 00000100:00100000:2.0:1787841761.427666:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 99 00000100:00100000:2.0:1787841761.427673:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbc9547840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+6:2354:x1874687695010944:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:0.0:1787841761.427908:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 100 00000100:00100000:0.0:1787841761.427919:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbc9545e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fe7d2185-ae43-428e-8bfa-909f60138853+5:2354:x1874687695011072:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:0.0:1787841761.427954:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbc9545e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fe7d2185-ae43-428e-8bfa-909f60138853+5:2354:x1874687695011072:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 38us (799us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841761.427969:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 100 00000100:00100000:2.0:1787841761.428552:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbc9547840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+6:2354:x1874687695010944:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 873us (1513us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841761.428564:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 99 00000100:00080000:2.0:1787841761.428819:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787841761.864312:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841762.880878:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841763.908670:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787841764.612153:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf8dc8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3299:1874687714970112:0@lo:400:kworker.0 00000100:00100000:1.0:1787841764.612263:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841764.612348:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf8dc9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1874687714970624:0@lo:400:kworker.0 00000100:00100000:1.0:1787841764.612491:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841764.612528:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787841764.612535:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf8dc9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874687714970496:0@lo:400:kworker.0 00000100:00100000:1.0:1787841764.612563:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841764.612607:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf8dcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874687714970240:0@lo:400:kworker.0 00000100:00100000:1.0:1787841764.612636:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841764.612656:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff3ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874687714970752:0@lo:400:kworker.0 00000100:00100000:1.0:1787841764.612678:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841764.612722:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787841764.612729:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf8dc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1874687714970368:0@lo:400:kworker.0 00000100:00100000:1.0:1787841764.612753:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841764.612793:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714970112 00000100:00100000:1.0:1787841764.612803:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714970112 00000100:00100000:1.0:1787841764.612861:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1787841764.612872:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:3299:x1874687714970112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841764.612959:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:3299:x1874687714970112:12345-0@lo:400:kworker.0 Request processed in 88us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841764.612968:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1787841764.613014:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714970496 00000100:00100000:1.0:1787841764.613018:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714970496 00000100:00100000:1.0:1787841764.613060:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714970752 00000100:00100000:1.0:1787841764.613064:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714970752 00000100:00100000:1.0:1787841764.613088:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787841764.613095:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff3eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1874687714970496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841764.613131:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff3eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1874687714970496:12345-0@lo:400:kworker.0 Request processed in 37us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841764.613138:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787841764.613151:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787841764.613158:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf07f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1874687714970752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841764.613191:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf07f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1874687714970752:12345-0@lo:400:kworker.0 Request processed in 34us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841764.613196:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787841764.613213:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714970624 00000100:00100000:1.0:1787841764.613217:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714970624 00000100:00100000:1.0:1787841764.613243:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714970240 00000100:00100000:1.0:1787841764.613247:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714970240 00000100:00100000:1.0:1787841764.613258:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714970368 00000100:00100000:1.0:1787841764.613260:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714970368 00000100:00100000:1.0:1787841764.617009:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787841764.617052:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff3eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1874687714970624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841764.617201:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff3eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1874687714970624:12345-0@lo:400:kworker.0 Request processed in 172us (4708us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841764.617238:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787841764.617274:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787841764.617422:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf07fa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874687714970240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841764.617464:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf07fa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874687714970240:12345-0@lo:400:kworker.0 Request processed in 183us (4827us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841764.617470:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787841764.617485:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787841764.617493:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf07f8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874687714970368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841764.617524:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf07f8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874687714970368:12345-0@lo:400:kworker.0 Request processed in 32us (4771us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841764.617530:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00010000:00080000:1.0:1787841764.617632:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbf8dc9a40 x1874687714970496/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787841780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787841764.617653:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf8dc9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874687714970496:0@lo:400:kworker.0 00000100:00100000:1.0:1787841764.617670:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf8dc8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3299:1874687714970112:0@lo:400:kworker.0 00000100:00100000:1.0:1787841764.617682:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf8dc9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1874687714970624:0@lo:400:kworker.0 00000100:00080000:1.0:1787841764.617749:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787841764.617758:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787841764.617761:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787841764.617793:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf8dc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1874687714970368:0@lo:400:kworker.0 00000100:00100000:1.0:1787841764.617805:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf8dcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874687714970240:0@lo:400:kworker.0 00010000:00080000:1.0:1787841764.617818:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbff3ead00 x1874687714970752/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787841780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787841764.617842:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff3ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874687714970752:0@lo:400:kworker.0 00000100:00100000:2.0:1787841764.622588:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbc95470c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874687714970880:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787841764.622688:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841764.622789:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714970880 00000100:00100000:2.0:1787841764.622812:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714970880 00000100:00100000:2.0:1787841764.622875:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787841764.622885:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbc9546940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874687714970880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787841764.622932:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787841764.622985:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbc9546940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874687714970880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841764.622993:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:2.0:1787841764.623047:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbc95470c0 x1874687714970880/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841780 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787841764.623069:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbc95470c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874687714970880:0@lo:13:osp-pre-1-0.0 00000001:02000400:1.0:1787841764.820898:0:11019:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1787841764.928843:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787841765.633017:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687714971008:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787841765.633096:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841765.633241:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714971008 00000100:00100000:2.0:1787841765.633248:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714971008 00000100:00100000:2.0:1787841765.633312:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787841765.633322:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf07fb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874687714971008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787841765.633361:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787841765.642158:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf07fb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874687714971008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 8813us (9037us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841765.642182:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:1.0:1787841765.645816:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbf6e292c0 x1874687714971008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841781 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787841765.645845:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687714971008:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787841765.953755:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787841766.550825:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841766.550872:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841766.550913:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841766.550962:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695011456 00000100:00100000:1.0:1787841766.550972:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695011456 00000100:00100000:1.0:1787841766.551033:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695011328 00000100:00100000:1.0:1787841766.551037:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695011328 00000100:00100000:1.0:1787841766.551062:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 104 00000100:00100000:1.0:1787841766.551072:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf07f9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fe7d2185-ae43-428e-8bfa-909f60138853+5:2354:x1874687695011456:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:1.0:1787841766.551155:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf07f9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fe7d2185-ae43-428e-8bfa-909f60138853+5:2354:x1874687695011456:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 85us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841766.551163:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 104 00000100:00100000:1.0:1787841766.551187:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 105 00000100:00100000:1.0:1787841766.551193:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf07fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+6:2354:x1874687695011328:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:1.0:1787841766.551219:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf07fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+6:2354:x1874687695011328:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 26us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841766.551244:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 105 00000100:00080000:1.0:1787841766.551266:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787841766.555236:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695011200 00000100:00100000:2.0:1787841766.555252:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695011200 00000100:00100000:2.0:1787841766.555317:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 238 00000100:00100000:2.0:1787841766.555327:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a1f1ce-26b5-4cc6-a1db-8e09063432da+13:2354:x1874687695011200:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:2.0:1787841766.555415:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a1f1ce-26b5-4cc6-a1db-8e09063432da+13:2354:x1874687695011200:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 89us (4599us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841766.555424:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 238 00010000:00010000:1.0:1787841766.976885:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841768.013381:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787841768.730473:0:11168:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff127b8df0 20000000:00000080:1.0:1787841768.730492:0:11168:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff92cbcdbd1400 uarg=0000000000000000 20000000:01000000:1.0:1787841768.731001:0:11168:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787841768.731008:0:11168:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787841768.731013:0:11168:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1787841768.737407:0:11169:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1787841768.737643:0:11168:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1787841768.753021:0:11168:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787841768.753079:0:11168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff92cc00d9d000/0xe3dac0c99affe371 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841768.753102:0:11168:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92cbc6599a00/0xe3dac0c99affe316 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6710 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841768.753111:0:11168:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92cbc169b600/0xe3dac0c99affe324 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe3dac0c99affe31d expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841768.753117:0:11168:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92cbc6725a00/0xe3dac0c99affe332 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe3dac0c99affe32b expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841768.753124:0:11168:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92cbc6724c00/0xe3dac0c99affe340 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe3dac0c99affe339 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841768.753130:0:11168:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92cbc169a200/0xe3dac0c99affe355 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6748 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841768.753138:0:11168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff92cc00d9d000/0xe3dac0c99affe371 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841768.753545:0:11168:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92cbc169a200/0xe3dac0c99affe355 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6748 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841768.753561:0:11168:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92cbc169a200/0xe3dac0c99affe355 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6748 expref: 12 pid: 5833 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841768.753576:0:11168:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff3ead00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11168:1874687714971136:192.168.201.1@tcp:104: 00010000:00010000:1.0:1787841768.753802:0:11168:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92cbc6724c00/0xe3dac0c99affe340 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe3dac0c99affe339 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841768.753812:0:11168:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92cbc6724c00/0xe3dac0c99affe340 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe3dac0c99affe339 expref: 18 pid: 5832 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841768.753822:0:11168:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf8dcb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11168:1874687714971264:0@lo:104: 00000100:00100000:1.0:1787841768.753871:0:11168:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787841768.753911:0:11168:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92cbc6725a00/0xe3dac0c99affe332 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe3dac0c99affe32b expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841768.753919:0:11168:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92cbc6725a00/0xe3dac0c99affe332 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe3dac0c99affe32b expref: 18 pid: 5832 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841768.753926:0:11168:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf8dc9680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11168:1874687714971392:0@lo:104: 00000100:00100000:1.0:1787841768.753944:0:11168:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787841768.753961:0:11168:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92cbc169b600/0xe3dac0c99affe324 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe3dac0c99affe31d expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841768.753968:0:11168:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92cbc169b600/0xe3dac0c99affe324 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe3dac0c99affe31d expref: 18 pid: 5831 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841768.753988:0:11168:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf8dc9a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11168:1874687714971520:0@lo:104: 00000100:00100000:1.0:1787841768.754023:0:11168:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787841768.754045:0:11168:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92cbc6599a00/0xe3dac0c99affe316 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6710 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841768.754053:0:11168:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92cbc6599a00/0xe3dac0c99affe316 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6710 expref: 12 pid: 5833 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841768.754061:0:11168:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbcd7a5680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11168:1874687714971648:192.168.201.1@tcp:104: 00000100:00100000:1.0:1787841768.754086:0:11168:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc2e590c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787841768.756160:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714971264 00000100:00100000:0.0:1787841768.756173:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714971264 00000100:00100000:3.0:1787841768.756329:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714971392 00000100:00100000:3.0:1787841768.756333:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714971392 00000100:00100000:3.0:1787841768.756377:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714971520 00000100:00100000:3.0:1787841768.756380:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714971520 00000100:00100000:3.0:1787841768.756398:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787841768.756408:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf8dc8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+5:11168:x1874687714971392:12345-0@lo:104: 00010000:00010000:3.0:1787841768.756424:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.101@tcp lock: ffff92cbc6724400/0xe3dac0c99affe32b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe3dac0c99affe332 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841768.756530:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787841768.756537:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf8dc8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+5:11168:x1874687714971392:12345-0@lo:104: Request processed in 131us (2591us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841768.756545:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787841768.756563:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787841768.756569:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd7a4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+4:11168:x1874687714971520:12345-0@lo:104: 00010000:00010000:3.0:1787841768.756577:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.101@tcp lock: ffff92cbc6598a00/0xe3dac0c99affe31d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe3dac0c99affe324 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841768.756612:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787841768.756617:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd7a4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+4:11168:x1874687714971520:12345-0@lo:104: Request processed in 49us (2594us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841768.756623:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:3.0:1787841768.756645:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787841768.756650:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.101@tcp lock: ffff92cbc6724400/0xe3dac0c99affe32b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe3dac0c99affe332 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841768.756657:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6724400 already unused, calling callback (ffffffffc1d9fc20) 10000000:00010000:3.0:1787841768.756661:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.101@tcp lock: ffff92cbc6724400/0xe3dac0c99affe32b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xe3dac0c99affe332 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841768.756682:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.101@tcp lock: ffff92cbc6724400/0xe3dac0c99affe32b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xe3dac0c99affe332 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787841768.756690:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.101@tcp lock: ffff92cbc6724400/0xe3dac0c99affe32b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xe3dac0c99affe332 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787841768.756719:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787841768.756760:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.101@tcp lock: ffff92cbc6724400/0xe3dac0c99affe32b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99affe332 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841768.756767:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787841768.756789:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.101@tcp lock: ffff92cbc6724400/0xe3dac0c99affe32b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99affe332 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841768.756796:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.101@tcp lock: ffff92cbc6724400/0xe3dac0c99affe32b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99affe332 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841768.756810:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787841768.756813:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.101@tcp lock: ffff92cbc6598a00/0xe3dac0c99affe31d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe3dac0c99affe324 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841768.756818:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6598a00 already unused, calling callback (ffffffffc1d9fc20) 10000000:00010000:3.0:1787841768.756821:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.101@tcp lock: ffff92cbc6598a00/0xe3dac0c99affe31d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe3dac0c99affe324 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841768.756827:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.101@tcp lock: ffff92cbc6598a00/0xe3dac0c99affe31d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe3dac0c99affe324 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787841768.756833:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.101@tcp lock: ffff92cbc6598a00/0xe3dac0c99affe31d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe3dac0c99affe324 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787841768.756844:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787841768.756858:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.101@tcp lock: ffff92cbc6598a00/0xe3dac0c99affe31d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99affe324 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841768.756863:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787841768.756877:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.101@tcp lock: ffff92cbc6598a00/0xe3dac0c99affe31d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99affe324 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841768.756884:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.101@tcp lock: ffff92cbc6598a00/0xe3dac0c99affe31d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99affe324 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841768.756892:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841768.756894:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841768.756895:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841768.756901:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787841768.756913:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e29e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3299:1874687714971776:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787841768.756950:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841768.756997:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e29a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3300:1874687714971904:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787841768.757023:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841768.757056:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714971776 00000100:00100000:3.0:1787841768.757060:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714971776 00010000:00010000:3.0:1787841768.757078:0:7632:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92cbc6725a00/0xe3dac0c99affe332 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe3dac0c99affe32b expref: 19 pid: 5832 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841768.757099:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714971904 00000100:00100000:3.0:1787841768.757102:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714971904 00010000:00010000:3.0:1787841768.757113:0:7632:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92cbc169b600/0xe3dac0c99affe324 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe3dac0c99affe31d expref: 20 pid: 5831 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841768.757146:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787841768.757152:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcdb7e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f6e7591a-84a0-4774-9d28-b3ed28591dc5+20:3299:x1874687714971776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787841768.757163:0:7632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787841768.757169:0:7632:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92cbc6725a00/0xe3dac0c99affe332 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe3dac0c99affe32b expref: 20 pid: 5832 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841768.757179:0:7632:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92cbc6725a00/0xe3dac0c99affe332 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe3dac0c99affe32b expref: 20 pid: 5832 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841768.757210:0:7632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787841768.757240:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcdb7e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f6e7591a-84a0-4774-9d28-b3ed28591dc5+20:3299:x1874687714971776:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841768.757246:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787841768.757323:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787841768.757329:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e2a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:3300:x1874687714971904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787841768.757337:0:7632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787841768.757342:0:7632:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92cbc169b600/0xe3dac0c99affe324 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe3dac0c99affe31d expref: 19 pid: 5831 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841768.757349:0:7632:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92cbc169b600/0xe3dac0c99affe324 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe3dac0c99affe31d expref: 19 pid: 5831 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841768.757359:0:7632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787841768.757386:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e2a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:3300:x1874687714971904:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841768.757392:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787841768.757436:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e29a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3300:1874687714971904:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787841768.757471:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e29e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3299:1874687714971776:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787841768.757868:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787841768.757876:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf8dc8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+3:11168:x1874687714971264:12345-0@lo:104: 00010000:00010000:0.0:1787841768.757885:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.101@tcp lock: ffff92cbc169ac00/0xe3dac0c99affe339 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe3dac0c99affe340 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841768.757925:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787841768.757930:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf8dc8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+3:11168:x1874687714971264:12345-0@lo:104: Request processed in 56us (4059us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841768.757936:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787841768.758051:0:11168:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf8dcb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11168:1874687714971264:0@lo:104: 00010000:00010000:1.0:1787841768.758063:0:11168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92cbc6725a00/0xe3dac0c99affe332 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe3dac0c99affe32b expref: 18 pid: 5832 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841768.758073:0:11168:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf8dc9680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11168:1874687714971392:0@lo:104: 00010000:00010000:1.0:1787841768.758081:0:11168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92cbc169b600/0xe3dac0c99affe324 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe3dac0c99affe31d expref: 17 pid: 5831 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841768.758089:0:11168:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf8dc9a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11168:1874687714971520:0@lo:104: 00010000:00010000:3.0:1787841768.761918:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787841768.761934:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.101@tcp lock: ffff92cbc169ac00/0xe3dac0c99affe339 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe3dac0c99affe340 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841768.761946:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc169ac00 already unused, calling callback (ffffffffc1d9fc20) 10000000:00010000:3.0:1787841768.761950:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.101@tcp lock: ffff92cbc169ac00/0xe3dac0c99affe339 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe3dac0c99affe340 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841768.761960:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.101@tcp lock: ffff92cbc169ac00/0xe3dac0c99affe339 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe3dac0c99affe340 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787841768.761966:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.101@tcp lock: ffff92cbc169ac00/0xe3dac0c99affe339 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe3dac0c99affe340 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787841768.761972:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787841768.762043:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.101@tcp lock: ffff92cbc169ac00/0xe3dac0c99affe339 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99affe340 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841768.762051:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787841768.762088:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.101@tcp lock: ffff92cbc169ac00/0xe3dac0c99affe339 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99affe340 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841768.762097:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.101@tcp lock: ffff92cbc169ac00/0xe3dac0c99affe339 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99affe340 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841768.762121:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841768.762123:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841768.762125:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787841768.762139:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787841768.762176:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e29e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3300:1874687714972032:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787841768.762256:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841768.762321:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714972032 00000100:00100000:3.0:1787841768.762328:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714972032 00010000:00010000:3.0:1787841768.762358:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92cbc6724c00/0xe3dac0c99affe340 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe3dac0c99affe339 expref: 17 pid: 5832 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841768.762388:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787841768.762397:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e29a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+17:3300:x1874687714972032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787841768.762411:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787841768.762416:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92cbc6724c00/0xe3dac0c99affe340 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe3dac0c99affe339 expref: 17 pid: 5832 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841768.762426:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92cbc6724c00/0xe3dac0c99affe340 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe3dac0c99affe339 expref: 17 pid: 5832 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841768.762440:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92cbc6724c00/0xe3dac0c99affe340 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe3dac0c99affe339 expref: 17 pid: 5832 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841768.762456:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787841768.762491:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e29a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+16:3300:x1874687714972032:12345-0@lo:103:ldlm_bl.0 Request processed in 95us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841768.762498:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787841768.762545:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e29e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3300:1874687714972032:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787841768.787139:0:11168:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff3ead00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11168:1874687714971136:192.168.201.1@tcp:104: 00000100:00100000:2.0:1787841768.787155:0:11168:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbcd7a5680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11168:1874687714971648:192.168.201.1@tcp:104: 00010000:00010000:2.0:1787841768.787221:0:11168:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff92cc00d9d000/0xe3dac0c99affe371 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841768.787685:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841768.787756:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841768.787825:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695011584 00000100:00100000:2.0:1787841768.787831:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695011584 00010000:00010000:2.0:1787841768.787866:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92cbc169a200/0xe3dac0c99affe355 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6748 expref: 13 pid: 5833 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841768.787896:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695011712 00000100:00100000:2.0:1787841768.787900:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695011712 00010000:00010000:2.0:1787841768.787913:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92cbc6599a00/0xe3dac0c99affe316 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6710 expref: 14 pid: 5833 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841768.787944:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 28 00000100:00100000:2.0:1787841768.787951:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e29e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09a1f1ce-26b5-4cc6-a1db-8e09063432da+14:2356:x1874687695011584:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787841768.787966:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787841768.787971:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92cbc169a200/0xe3dac0c99affe355 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6748 expref: 14 pid: 5833 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841768.787981:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92cbc169a200/0xe3dac0c99affe355 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6748 expref: 14 pid: 5833 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841768.787999:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92cbc169a200/0xe3dac0c99affe355 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6748 expref: 14 pid: 5833 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841768.788014:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787841768.788075:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e29e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09a1f1ce-26b5-4cc6-a1db-8e09063432da+13:2356:x1874687695011584:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 123us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841768.788083:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 28 00000100:00100000:2.0:1787841768.788101:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 29 00000100:00100000:2.0:1787841768.788107:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e283c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09a1f1ce-26b5-4cc6-a1db-8e09063432da+12:2356:x1874687695011712:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787841768.788116:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787841768.788120:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92cbc6599a00/0xe3dac0c99affe316 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6710 expref: 12 pid: 5833 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841768.788130:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92cbc6599a00/0xe3dac0c99affe316 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6710 expref: 12 pid: 5833 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841768.788140:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92cbc6599a00/0xe3dac0c99affe316 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6710 expref: 12 pid: 5833 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841768.788153:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff92cc00d9d000/0xe3dac0c99affe371 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841768.788162:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92cc00d9d000/0xe3dac0c99affe371 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841768.788177:0:5824:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92cc00d9d000/0xe3dac0c99affe371 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841768.788199:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92cc00d9d000/0xe3dac0c99affe371 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841768.788206:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff92cc00d9d000/0xe3dac0c99affe371 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841768.788212:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff92cc00d9d000/0xe3dac0c99affe371 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841768.788224:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cc00d9d000 already unused, calling callback (ffffffffc17a4500) 00010000:00010000:2.0:1787841768.788229:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff92cc00d9d000/0xe3dac0c99affe371 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841768.788237:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff92cc00d9d000/0xe3dac0c99affe371 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841768.788251:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff92cc00d9d000/0xe3dac0c99affe371 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841768.788260:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787841768.788288:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e283c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09a1f1ce-26b5-4cc6-a1db-8e09063432da+11:2356:x1874687695011712:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 174us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841768.788295:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 29 00010000:00010000:2.0:1787841768.788317:0:11168:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff92cc00d9d000/0xe3dac0c99affe371 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841768.788325:0:11168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff92cc00d9d000/0xe3dac0c99affe371 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841768.788331:0:11168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92cc00d9d000/0xe3dac0c99affe371 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841769.028783:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787841769.729114:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787841769.729140:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbc95470c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874687714972160:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787841769.729276:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841769.729328:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714972160 00000100:00100000:1.0:1787841769.729337:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714972160 00000100:00100000:1.0:1787841769.729431:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787841769.729441:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd5ac780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874687714972160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787841769.729480:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787841769.729551:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd5ac780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874687714972160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841769.729572:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:1.0:1787841769.729595:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787841769.729912:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbc95470c0 x1874687714972160/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841785 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787841769.729946:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbc95470c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874687714972160:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787841769.730228:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbc9546d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687714972672:0@lo:400:kworker.0 00000100:00100000:3.0:1787841769.730280:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841769.730323:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787841769.730329:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbc9544b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3298:1874687714972288:0@lo:400:kworker.0 00000100:00100000:3.0:1787841769.730356:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841769.730379:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbc95452c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1874687714972800:0@lo:400:kworker.0 00000100:00100000:3.0:1787841769.730433:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841769.730463:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714972288 00000100:00100000:3.0:1787841769.730468:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714972288 00000100:00100000:3.0:1787841769.730744:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1787841769.730753:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+16:3298:x1874687714972288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787841769.730801:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+16:3298:x1874687714972288:12345-0@lo:400:kworker.0 Request processed in 50us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841769.730807:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1787841769.730849:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbc9544b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3298:1874687714972288:0@lo:400:kworker.0 00000100:00100000:2.0:1787841769.731105:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714972672 00000100:00100000:2.0:1787841769.731110:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714972672 00000100:00100000:2.0:1787841769.731160:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787841769.731168:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e28b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1874687714972672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841769.731212:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e28b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1874687714972672:12345-0@lo:400:kworker.0 Request processed in 45us (931us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841769.731229:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787841769.731315:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbc9546580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874687714972416:0@lo:400:kworker.0 00000100:00100000:1.0:1787841769.731345:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841769.731375:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787841769.731381:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbc95443c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1874687714972544:0@lo:400:kworker.0 00000100:00100000:1.0:1787841769.731808:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841769.731843:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714972800 00000100:00100000:1.0:1787841769.731847:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714972800 00000100:00100000:1.0:1787841769.731876:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714972416 00000100:00100000:1.0:1787841769.731878:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714972416 00000100:00100000:1.0:1787841769.731888:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714972544 00000100:00100000:1.0:1787841769.731890:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714972544 00000100:00100000:1.0:1787841769.731904:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787841769.731910:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e292c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1874687714972800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787841769.732035:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787841769.732044:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd7a5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874687714972416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787841769.732083:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd7a5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874687714972416:12345-0@lo:400:kworker.0 Request processed in 41us (737us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841769.732089:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787841769.732103:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787841769.732109:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd7a61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874687714972544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787841769.732131:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd7a61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874687714972544:12345-0@lo:400:kworker.0 Request processed in 22us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841769.732136:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:3.0:1787841769.732150:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787841769.732153:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787841769.732172:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbc95443c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1874687714972544:0@lo:400:kworker.0 00000100:00100000:3.0:1787841769.732191:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbc9546580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874687714972416:0@lo:400:kworker.0 00010000:00080000:3.0:1787841769.732217:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbc9546d00 x1874687714972672/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787841785 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787841769.732227:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbc9546d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687714972672:0@lo:400:kworker.0 00000100:00100000:1.0:1787841769.737942:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e292c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1874687714972800:12345-0@lo:400:kworker.0 Request processed in 6015us (7491us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841769.737958:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787841769.738135:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbc95452c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1874687714972800:0@lo:400:kworker.0 00010000:00010000:3.0:1787841770.048959:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787841770.472299:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841770.472354:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695011840 00000100:00100000:2.0:1787841770.472365:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695011840 00000100:00100000:2.0:1787841770.472418:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 240 00000100:00100000:2.0:1787841770.472428:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a1f1ce-26b5-4cc6-a1db-8e09063432da+11:5607:x1874687695011840:12345-192.168.201.1@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787841770.472448:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841770.472468:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92cbc6599c00/0xe3dac0c99affe378 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6772 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841770.475791:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92cbc6599c00/0xe3dac0c99affe378 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6772 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841770.475810:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92cbc6599c00/0xe3dac0c99affe378 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6772 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841770.475821:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc6599c00, rc 0) 00000100:00100000:2.0:1787841770.475898:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a1f1ce-26b5-4cc6-a1db-8e09063432da+12:5607:x1874687695011840:12345-192.168.201.1@tcp:101:ll_cfg_requeue.0 Request processed in 3470us (3610us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841770.475907:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 240 00000100:00100000:3.0:1787841770.480285:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841770.480353:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695011968 00000100:00100000:2.0:1787841770.480363:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695011968 00000100:00100000:2.0:1787841770.480415:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 241 00000100:00100000:2.0:1787841770.480424:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a1f1ce-26b5-4cc6-a1db-8e09063432da+12:5607:x1874687695011968:12345-192.168.201.1@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787841770.480795:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a1f1ce-26b5-4cc6-a1db-8e09063432da+12:5607:x1874687695011968:12345-192.168.201.1@tcp:501:ll_cfg_requeue.0 Request processed in 370us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841770.480815:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 241 00000100:00100000:3.0:1787841770.486249:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841770.486343:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695012096 00000100:00100000:2.0:1787841770.486354:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695012096 00000100:00100000:2.0:1787841770.486417:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 242 00000100:00100000:2.0:1787841770.486428:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a1f1ce-26b5-4cc6-a1db-8e09063432da+12:5607:x1874687695012096:12345-192.168.201.1@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787841770.486687:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a1f1ce-26b5-4cc6-a1db-8e09063432da+12:5607:x1874687695012096:12345-192.168.201.1@tcp:503:ll_cfg_requeue.0 Request processed in 260us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841770.486721:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 242 00000100:00100000:2.0:1787841770.497694:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841770.498017:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695012224 00000100:00100000:3.0:1787841770.498028:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695012224 00000100:00100000:3.0:1787841770.498083:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 243 00000100:00100000:3.0:1787841770.498094:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a1f1ce-26b5-4cc6-a1db-8e09063432da+12:5607:x1874687695012224:12345-192.168.201.1@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787841770.498110:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841770.498127:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92cbc149de00/0xe3dac0c99affe37f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6779 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841770.498155:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92cbc149de00/0xe3dac0c99affe37f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6779 expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841770.498168:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92cbc149de00/0xe3dac0c99affe37f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6779 expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841770.498178:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc149de00, rc 0) 00000100:00100000:3.0:1787841770.498235:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a1f1ce-26b5-4cc6-a1db-8e09063432da+13:5607:x1874687695012224:12345-192.168.201.1@tcp:101:ll_cfg_requeue.0 Request processed in 143us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841770.498243:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 243 00000100:00100000:3.0:1787841770.502904:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841770.503008:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695012352 00000100:00100000:2.0:1787841770.503018:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695012352 00000100:00100000:2.0:1787841770.503077:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 244 00000100:00100000:2.0:1787841770.503087:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a1f1ce-26b5-4cc6-a1db-8e09063432da+13:5607:x1874687695012352:12345-192.168.201.1@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787841770.503404:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a1f1ce-26b5-4cc6-a1db-8e09063432da+13:5607:x1874687695012352:12345-192.168.201.1@tcp:501:ll_cfg_requeue.0 Request processed in 317us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841770.503412:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 244 10000000:01000000:3.0:1787841770.504527:0:5836:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787841770.504533:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92cbff856800 from 7 10000000:01000000:3.0:1787841770.504538:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787841770.504600:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc149c000/0xe3dac0c99affe386 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841770.504612:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff92cbc149c000/0xe3dac0c99affe386 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841770.504622:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff92cbc149c000/0xe3dac0c99affe386 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841770.504647:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e2bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714972928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787841770.504730:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841770.504779:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cc01d84480 going to sleep for 11 seconds 00000100:00100000:0.0:1787841770.504948:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714972928 00000100:00100000:0.0:1787841770.504956:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714972928 00000100:00100000:0.0:1787841770.505004:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1787841770.505014:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+16:5836:x1874687714972928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787841770.505029:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841770.505043:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92cbc6725800/0xe3dac0c99affe38d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe3dac0c99affe386 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841770.505089:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92cbc6725800/0xe3dac0c99affe38d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe3dac0c99affe386 expref: 17 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841770.505102:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92cbc6725800/0xe3dac0c99affe38d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe3dac0c99affe386 expref: 17 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841770.505112:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc6725800, rc 0) 00000100:00100000:0.0:1787841770.505157:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+17:5836:x1874687714972928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841770.505163:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1787841770.507690:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e2bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714972928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787841770.507737:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff92cbc149c000/0xe3dac0c99affe386 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe38d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841770.507749:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff92cbc149c000/0xe3dac0c99affe386 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe3dac0c99affe38d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841770.507827:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e2bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714973056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787841770.507884:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841770.507921:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cc01d84480 going to sleep for 11 seconds 00000100:00100000:3.0:1787841770.507941:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714973056 00000100:00100000:3.0:1787841770.507946:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714973056 00000100:00100000:3.0:1787841770.507988:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1787841770.507995:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+17:5836:x1874687714973056:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787841770.508300:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+17:5836:x1874687714973056:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 303us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841770.508308:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1787841770.508355:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e2bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714973056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787841770.508383:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e2bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714973184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787841770.508424:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841770.508437:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cc01d84480 going to sleep for 11 seconds 00000100:00100000:3.0:1787841770.508449:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714973184 00000100:00100000:3.0:1787841770.508453:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714973184 00000100:00100000:3.0:1787841770.508474:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1787841770.508490:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+17:5836:x1874687714973184:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787841770.509857:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841770.512938:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+17:5836:x1874687714973184:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 4439us (4504us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841770.512952:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1787841770.513003:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695012480 00000100:00100000:3.0:1787841770.513011:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695012480 00000100:00100000:3.0:1787841770.513048:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 248 00000100:00100000:3.0:1787841770.513057:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a1f1ce-26b5-4cc6-a1db-8e09063432da+13:5607:x1874687695012480:12345-192.168.201.1@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787841770.513232:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a1f1ce-26b5-4cc6-a1db-8e09063432da+13:5607:x1874687695012480:12345-192.168.201.1@tcp:503:ll_cfg_requeue.0 Request processed in 175us (3382us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841770.513239:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 248 00000100:00100000:0.0:1787841770.514796:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e2bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714973184:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787841770.536302:0:11203:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1787841770.536855:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1787841770.536902:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787841770.536922:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc149c000/0xe3dac0c99affe386 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe38d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841770.536953:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff92cbc149c000/0xe3dac0c99affe386 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe38d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787841770.536964:0:5836:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787841770.536967:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92cbf04e3800 from 7 10000000:01000000:3.0:1787841770.536969:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787841770.537010:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc149c400/0xe3dac0c99affe394 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841770.537018:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff92cbc149c400/0xe3dac0c99affe394 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841770.537030:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff92cbc149c400/0xe3dac0c99affe394 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841770.537056:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e2bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714973312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787841770.537125:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841770.537168:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cc01d84180 going to sleep for 11 seconds 00000100:00100000:0.0:1787841770.537436:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714973312 00000100:00100000:0.0:1787841770.537443:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714973312 00000100:00100000:0.0:1787841770.537503:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1787841770.537512:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+17:5836:x1874687714973312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787841770.537526:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841770.537539:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92cbc6724000/0xe3dac0c99affe39b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe3dac0c99affe394 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841770.537678:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92cbc6724000/0xe3dac0c99affe39b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe3dac0c99affe394 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841770.537690:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92cbc6724000/0xe3dac0c99affe39b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe3dac0c99affe394 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841770.537732:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc6724000, rc 0) 00000100:00100000:0.0:1787841770.537776:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+18:5836:x1874687714973312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 265us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841770.537782:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1787841770.538392:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e2bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714973312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787841770.538411:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff92cbc149c400/0xe3dac0c99affe394 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe39b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841770.538421:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff92cbc149c400/0xe3dac0c99affe394 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe3dac0c99affe39b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841770.538493:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e2bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714973440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787841770.538531:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841770.538585:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cc01d84180 going to sleep for 11 seconds 00000100:00100000:0.0:1787841770.539221:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714973440 00000100:00100000:0.0:1787841770.539228:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714973440 00000100:00100000:0.0:1787841770.539359:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1787841770.539369:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+18:5836:x1874687714973440:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787841770.540158:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+18:5836:x1874687714973440:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 788us (1623us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841770.540167:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1787841770.547407:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e2bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714973440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787841770.547487:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e2bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714973568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787841770.551920:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841770.551989:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cc01d84180 going to sleep for 11 seconds 00000100:00100000:1.0:1787841770.552407:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714973568 00000100:00100000:1.0:1787841770.552418:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714973568 00000100:00100000:1.0:1787841770.552486:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1787841770.552495:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+18:5836:x1874687714973568:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787841770.552752:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+18:5836:x1874687714973568:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 257us (851us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841770.552760:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1787841770.554411:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e2bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714973568:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787841770.556619:0:11206:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1787841770.557030:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1787841770.557063:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787841770.557074:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc149c400/0xe3dac0c99affe394 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe39b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841770.557087:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff92cbc149c400/0xe3dac0c99affe394 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe39b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787841770.557097:0:5836:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787841770.557100:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92cbc3ed8000 from 7 10000000:01000000:2.0:1787841770.557109:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787841770.557147:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc6598a00/0xe3dac0c99affe3a2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841770.557155:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff92cbc6598a00/0xe3dac0c99affe3a2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841770.557165:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff92cbc6598a00/0xe3dac0c99affe3a2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841770.557190:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbc9547c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714973696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787841770.557331:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841770.557374:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbf732be40 going to sleep for 11 seconds 00000100:00100000:0.0:1787841770.557423:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714973696 00000100:00100000:0.0:1787841770.557431:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714973696 00000100:00100000:0.0:1787841770.557488:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1787841770.557506:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+18:5836:x1874687714973696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787841770.557521:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841770.557536:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92cbc6724800/0xe3dac0c99affe3a9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe3dac0c99affe3a2 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841770.557574:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92cbc6724800/0xe3dac0c99affe3a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe3dac0c99affe3a2 expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841770.557586:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92cbc6724800/0xe3dac0c99affe3a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe3dac0c99affe3a2 expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841770.557596:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc6724800, rc 0) 00000100:00100000:0.0:1787841770.557650:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:5836:x1874687714973696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 155us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841770.557656:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1787841770.557830:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbc9547c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714973696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787841770.557845:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff92cbc6598a00/0xe3dac0c99affe3a2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe3a9 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841770.557854:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff92cbc6598a00/0xe3dac0c99affe3a2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe3dac0c99affe3a9 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841770.557902:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbc9547c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714973824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787841770.557928:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841770.557945:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbf732be40 going to sleep for 11 seconds 00000100:00100000:0.0:1787841770.558006:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714973824 00000100:00100000:0.0:1787841770.558011:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714973824 00000100:00100000:0.0:1787841770.558042:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1787841770.558049:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:5836:x1874687714973824:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787841770.558397:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:5836:x1874687714973824:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 348us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841770.558404:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1787841770.558461:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbc9547c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714973824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787841770.558498:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbc9547c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714973952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787841770.558537:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841770.558574:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbf732be40 going to sleep for 11 seconds 00000100:00100000:3.0:1787841770.558908:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714973952 00000100:00100000:3.0:1787841770.558924:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714973952 00000100:00100000:3.0:1787841770.558966:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1787841770.558975:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:5836:x1874687714973952:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787841770.559162:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:5836:x1874687714973952:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 189us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841770.559170:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1787841770.559346:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbc9547c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714973952:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787841770.561353:0:11207:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1787841770.561505:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1787841770.561523:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787841770.561533:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc6598a00/0xe3dac0c99affe3a2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe3a9 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841770.561545:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff92cbc6598a00/0xe3dac0c99affe3a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe3a9 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841770.753160:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e2bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874687714974080:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787841770.753266:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841770.753457:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714974080 00000100:00100000:3.0:1787841770.753466:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714974080 00000100:00100000:3.0:1787841770.753537:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787841770.753547:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd7a4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874687714974080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787841770.753587:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787841770.753639:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd7a4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874687714974080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841770.753647:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:1.0:1787841770.753749:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbf6e2bc00 x1874687714974080/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841786 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787841770.753768:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e2bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874687714974080:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787841771.073009:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787841771.663160:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841771.663205:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841771.663240:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841771.663301:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695012736 00000100:00100000:3.0:1787841771.663311:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695012736 00000100:00100000:3.0:1787841771.663429:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695012864 00000100:00100000:3.0:1787841771.663433:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695012864 00000100:00100000:3.0:1787841771.663471:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 109 00000100:00100000:3.0:1787841771.663480:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbc9547c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+6:2354:x1874687695012736:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:3.0:1787841771.663597:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbc9547c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+6:2354:x1874687695012736:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 117us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841771.663606:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 109 00000100:00100000:3.0:1787841771.663624:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 110 00000100:00100000:3.0:1787841771.663631:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbc95452c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fe7d2185-ae43-428e-8bfa-909f60138853+5:2354:x1874687695012864:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:3.0:1787841771.663656:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbc95452c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fe7d2185-ae43-428e-8bfa-909f60138853+5:2354:x1874687695012864:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 26us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841771.663662:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 110 00000100:00080000:2.0:1787841771.663834:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787841771.664143:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695012608 00000100:00100000:1.0:1787841771.664148:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695012608 00000100:00100000:1.0:1787841771.664186:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 255 00000100:00100000:1.0:1787841771.664194:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a1f1ce-26b5-4cc6-a1db-8e09063432da+13:2354:x1874687695012608:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:1.0:1787841771.664239:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a1f1ce-26b5-4cc6-a1db-8e09063432da+13:2354:x1874687695012608:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 46us (1033us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841771.664246:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 255 00010000:00010000:2.0:1787841772.098082:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841773.121861:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787841773.644613:0:11367:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg101-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787841774.145286:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787841774.852192:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787841774.852219:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbc9546d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874687714974208:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787841774.852289:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841774.852364:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714974208 00000100:00100000:2.0:1787841774.852371:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714974208 00000100:00100000:2.0:1787841774.852433:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787841774.852443:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbc9546580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874687714974208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787841774.852477:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787841774.852529:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbc9546580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874687714974208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841774.852536:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:2.0:1787841774.852556:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787841774.852588:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbc9546d00 x1874687714974208/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841790 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787841774.852606:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbc9546d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874687714974208:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787841774.853519:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbcd5ae940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3298:1874687714974336:0@lo:400:kworker.0 00000100:00100000:0.0:1787841774.853519:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbcd5acb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874687714974720:0@lo:400:kworker.0 00000100:00100000:3.0:1787841774.853563:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841774.853563:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841774.853613:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbcd5acf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1874687714974592:0@lo:400:kworker.0 00000100:00100000:1.0:1787841774.853614:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbcd5ad680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874687714974464:0@lo:400:kworker.0 00000100:00100000:0.0:1787841774.860580:0:9572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714974720 00000100:00100000:0.0:1787841774.860596:0:9572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714974720 00000100:00100000:0.0:1787841774.860671:0:9572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787841774.860680:0:9572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd5ad2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1874687714974720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841774.860784:0:9572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd5ad2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1874687714974720:12345-0@lo:400:kworker.0 Request processed in 105us (7220us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841774.860791:0:9572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:0.0:1787841774.860815:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787841774.860846:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbcd5acb40 x1874687714974720/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787841790 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787841774.860860:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbcd5acb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874687714974720:0@lo:400:kworker.0 00000100:00100000:0.0:1787841774.860907:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714974336 00000100:00100000:0.0:1787841774.860911:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714974336 00000100:00100000:0.0:1787841774.860938:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1787841774.860945:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe9a1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:3298:x1874687714974336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841774.860998:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe9a1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:3298:x1874687714974336:12345-0@lo:400:kworker.0 Request processed in 54us (7434us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841774.861005:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1787841774.861623:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbcd5ae940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3298:1874687714974336:0@lo:400:kworker.0 00000100:00100000:3.0:1787841774.861636:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbcd5af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1874687714974848:0@lo:400:kworker.0 00000100:00100000:3.0:1787841774.861673:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841774.862668:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714974848 00000100:00100000:0.0:1787841774.862679:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714974848 00000100:00100000:0.0:1787841774.862765:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787841774.862776:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e28780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1874687714974848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841774.862843:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e28780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1874687714974848:12345-0@lo:400:kworker.0 Request processed in 70us (1170us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841774.862851:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:3.0:1787841774.863477:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787841774.863514:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbcd5af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1874687714974848:0@lo:400:kworker.0 00000100:00100000:2.0:1787841774.865899:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841774.866670:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841774.873618:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714974592 00000100:00100000:3.0:1787841774.873634:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714974592 00000100:00100000:3.0:1787841774.873732:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714974464 00000100:00100000:3.0:1787841774.873736:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714974464 00000100:00100000:3.0:1787841774.873761:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787841774.873771:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbc9546d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874687714974592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787841774.873877:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbc9546d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874687714974592:12345-0@lo:400:kworker.0 Request processed in 108us (7986us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841774.873884:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787841774.873910:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787841774.873916:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd7a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874687714974464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787841774.873948:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd7a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874687714974464:12345-0@lo:400:kworker.0 Request processed in 32us (7281us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841774.873954:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787841774.874001:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbcd5ad680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874687714974464:0@lo:400:kworker.0 00000100:00100000:2.0:1787841774.874388:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbcd5acf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1874687714974592:0@lo:400:kworker.0 00000100:00080000:1.0:1787841774.875669:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787841775.173221:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787841775.872846:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787841775.873280:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbcd7a5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687714974976:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787841775.873350:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841775.873446:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714974976 00000100:00100000:2.0:1787841775.873453:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714974976 00000100:00100000:2.0:1787841775.873504:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787841775.873513:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd7a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874687714974976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787841775.873548:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787841775.873592:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd7a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874687714974976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841775.873599:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:2.0:1787841775.873633:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbcd7a5e00 x1874687714974976/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841791 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787841775.873648:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbcd7a5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687714974976:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787841776.195315:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787841776.782493:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841776.782595:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841776.782635:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841776.782749:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695012992 00000100:00100000:0.0:1787841776.782762:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695012992 00000100:00100000:0.0:1787841776.782834:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 257 00000100:00100000:0.0:1787841776.782845:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe9a19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a1f1ce-26b5-4cc6-a1db-8e09063432da+13:2355:x1874687695012992:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:0.0:1787841776.782937:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe9a19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a1f1ce-26b5-4cc6-a1db-8e09063432da+13:2355:x1874687695012992:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 93us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841776.782944:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 257 00000100:00100000:3.0:1787841776.784615:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695013120 00000100:00100000:3.0:1787841776.784631:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695013120 00000100:00100000:3.0:1787841776.784768:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695013248 00000100:00100000:3.0:1787841776.784773:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695013248 00000100:00080000:1.0:1787841776.784824:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787841776.784900:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 114 00000100:00100000:0.0:1787841776.784913:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbc95443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+6:2355:x1874687695013120:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:0.0:1787841776.784998:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbc95443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+6:2355:x1874687695013120:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 87us (2518us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841776.785005:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 114 00000100:00100000:0.0:1787841776.785023:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 115 00000100:00100000:0.0:1787841776.785029:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbc9544b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fe7d2185-ae43-428e-8bfa-909f60138853+5:2355:x1874687695013248:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:0.0:1787841776.785075:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbc9544b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fe7d2185-ae43-428e-8bfa-909f60138853+5:2355:x1874687695013248:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 46us (2439us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841776.785081:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 115 00010000:00010000:3.0:1787841777.219894:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787841777.989086:0:11466:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 10:42:56 (1787841776) === 00010000:00010000:0.0:1787841778.242827:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787841778.274038:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841778.274083:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841778.274117:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695013376 00000100:00100000:1.0:1787841778.274140:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695013376 00000100:00100000:1.0:1787841778.274204:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 14 00000100:00100000:1.0:1787841778.274215:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd7a6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+6:2356:x1874687695013376:12345-192.168.201.1@tcp:41:mkdir.0 00000004:00000024:1.0:1787841778.274272:0:5837:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787841778.274396:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd7a6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+6:2356:x1874687695013376:12345-192.168.201.1@tcp:41:mkdir.0 Request processed in 182us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841778.274404:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 14 00000100:00080000:1.0:1787841778.274428:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787841778.276293:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695013504 00000100:00100000:2.0:1787841778.276311:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695013504 00000100:00100000:2.0:1787841778.276380:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 0 00000100:00100000:2.0:1787841778.276391:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd7a70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:b2767a54-6703-4908-8414-eab6601e2ceb+6:9694:x1874687695013504:12345-192.168.201.1@tcp:700:mkdir.0 00000100:00100000:2.0:1787841778.276480:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd7a70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:b2767a54-6703-4908-8414-eab6601e2ceb+6:9694:x1874687695013504:12345-192.168.201.1@tcp:700:mkdir.0 Request processed in 90us (2452us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841778.276489:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 0 00000100:00100000:0.0:1787841778.287308:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841778.287491:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695013760 00000100:00100000:3.0:1787841778.287501:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695013760 00000100:00100000:3.0:1787841778.287632:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 15 00000100:00100000:3.0:1787841778.287643:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd5af840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+6:9694:x1874687695013760:12345-192.168.201.1@tcp:36:mkdir.0 00010000:00010000:3.0:1787841778.287695:0:9449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787841778.287785:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169a800/0xe3dac0c99affe291 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d66fb expref: 6 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841778.287816:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92cbd1fc7a00) 00010000:00010000:3.0:1787841778.287827:0:9449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787841778.291304:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affe3b0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841778.291328:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affe3b0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841778.291341:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affe3b0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841778.291364:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149cc00/0xe3dac0c99affe3b7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841778.291371:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149cc00/0xe3dac0c99affe3b7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841778.291377:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149cc00/0xe3dac0c99affe3b7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787841778.293128:0:9449:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:3.0:1787841778.293149:0:9449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affe3b0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841778.293159:0:9449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affe3b0 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841778.293167:0:9449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affe3b0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841778.293173:0:9449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc149d600 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:3.0:1787841778.293182:0:9449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affe3b0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841778.293191:0:9449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affe3b0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841778.293205:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92cbc89cd400) 00010000:00010000:3.0:1787841778.293208:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787841778.293212:0:9449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affe3b0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841778.293218:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affe3b0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787841778.293238:0:9449:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001d83f772 reply state 00000000b9b79fe1 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149cc00/0xe3dac0c99affe3b7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841778.293246:0:9449:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787841778.293514:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd5af840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+7:9694:x1874687695013760:12345-192.168.201.1@tcp:36:mkdir.0 Request processed in 5869us (6209us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1787841778.293524:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 15 00010000:00010000:3.0:1787841778.298647:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149cc00/0xe3dac0c99affe3b7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841778.298666:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149cc00/0xe3dac0c99affe3b7 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841778.298674:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149cc00/0xe3dac0c99affe3b7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841778.298680:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc149cc00 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:3.0:1787841778.298684:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149cc00/0xe3dac0c99affe3b7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841778.298745:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149cc00/0xe3dac0c99affe3b7 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841778.298761:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff92cbc89cdb00) 00010000:00010000:3.0:1787841778.298764:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787841778.298769:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149cc00/0xe3dac0c99affe3b7 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841778.298776:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149cc00/0xe3dac0c99affe3b7 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841778.308441:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841778.308765:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695013888 00000100:00100000:1.0:1787841778.308777:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695013888 00000100:00100000:1.0:1787841778.308851:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 16 00000100:00100000:1.0:1787841778.308861:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd5acb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+6:9695:x1874687695013888:12345-192.168.201.1@tcp:101:chmod.0 00010000:00010000:1.0:1787841778.308887:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841778.308914:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c600/0xe3dac0c99affe3be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6780 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841778.308988:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c400/0xe3dac0c99affe3c5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841778.309002:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c400/0xe3dac0c99affe3c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841778.309013:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c400/0xe3dac0c99affe3c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787841778.309071:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1787841778.309074:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1787841778.309113:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c400/0xe3dac0c99affe3c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841778.309139:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c600/0xe3dac0c99affe3be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6780 expref: 8 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841778.309157:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c400/0xe3dac0c99affe3c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6780 expref: 7 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841778.309318:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92cbd1fc7500) 00010000:00010000:1.0:1787841778.309321:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787841778.309325:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cc00d9c400, rc 0) 00000100:00100000:0.0:1787841778.315896:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd5acb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+7:9695:x1874687695013888:12345-192.168.201.1@tcp:101:chmod.0 Request processed in 7024us (7454us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841778.315911:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 16 00000100:00100000:1.0:1787841778.318968:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841778.319067:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695014144 00000100:00100000:0.0:1787841778.319079:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695014144 00000100:00100000:0.0:1787841778.319142:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 17 00000100:00100000:0.0:1787841778.319154:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd7a4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2767a54-6703-4908-8414-eab6601e2ceb+7:9695:x1874687695014144:12345-192.168.201.1@tcp:36:chmod.0 00010000:00010000:0.0:1787841778.319214:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787841778.319246:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c400/0xe3dac0c99affe3c5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6780 expref: 7 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841778.319269:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92cbd1fc7500) 00010000:00010000:0.0:1787841778.319281:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787841778.319309:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725400/0xe3dac0c99affe3cc lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841778.319322:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725400/0xe3dac0c99affe3cc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841778.319333:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725400/0xe3dac0c99affe3cc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787841778.319667:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a00daca6 reply state 0000000095dee107 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725400/0xe3dac0c99affe3cc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841778.319677:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1787841778.319690:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1787841778.319903:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd7a4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2767a54-6703-4908-8414-eab6601e2ceb+8:9695:x1874687695014144:12345-192.168.201.1@tcp:36:chmod.0 Request processed in 750us (946us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1787841778.319911:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 17 00010000:00010000:3.0:1787841778.335923:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725400/0xe3dac0c99affe3cc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841778.335942:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725400/0xe3dac0c99affe3cc lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841778.336033:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725400/0xe3dac0c99affe3cc lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841778.336039:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6725400 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:3.0:1787841778.336044:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725400/0xe3dac0c99affe3cc lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841778.336053:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725400/0xe3dac0c99affe3cc lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841778.336071:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92cbc57e3f00) 00010000:00010000:3.0:1787841778.336075:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787841778.336081:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725400/0xe3dac0c99affe3cc lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841778.336100:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725400/0xe3dac0c99affe3cc lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841778.357371:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841778.357975:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695014272 00000100:00100000:3.0:1787841778.357991:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695014272 00000100:00100000:3.0:1787841778.358231:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 18 00000100:00100000:3.0:1787841778.358246:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd7a6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+7:9696:x1874687695014272:12345-192.168.201.1@tcp:101:chown.0 00010000:00010000:3.0:1787841778.358282:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841778.358316:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149cc00/0xe3dac0c99affe3d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6787 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841778.358545:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affe3da lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841778.358565:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affe3da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841778.358581:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affe3da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787841778.358675:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1787841778.358680:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787841778.358791:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affe3da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841778.358827:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149cc00/0xe3dac0c99affe3d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6787 expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841778.358853:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affe3da lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6787 expref: 8 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841778.358995:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92cbc89cdb00) 00010000:00010000:3.0:1787841778.358998:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787841778.359003:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc149d600, rc 0) 00000100:00100000:3.0:1787841778.359242:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd7a6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+8:9696:x1874687695014272:12345-192.168.201.1@tcp:101:chown.0 Request processed in 999us (1893us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841778.359252:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 18 00000100:00100000:0.0:1787841778.363422:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841778.363580:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695014400 00000100:00100000:3.0:1787841778.363595:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695014400 00000100:00100000:3.0:1787841778.363674:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 19 00000100:00100000:3.0:1787841778.363688:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd5acf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+8:9696:x1874687695014400:12345-192.168.201.1@tcp:101:chown.0 00010000:00010000:3.0:1787841778.363761:0:9449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841778.363791:0:9449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affe3e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d678e expref: -99 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841778.363903:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169a800/0xe3dac0c99affe3e8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841778.363922:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169a800/0xe3dac0c99affe3e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841778.363936:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169a800/0xe3dac0c99affe3e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841778.363955:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169a200/0xe3dac0c99affe3ef lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841778.363961:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169a200/0xe3dac0c99affe3ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841778.363991:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169a200/0xe3dac0c99affe3ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841778.364123:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169ac00/0xe3dac0c99affe3f6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841778.364131:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169ac00/0xe3dac0c99affe3f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841778.364138:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169ac00/0xe3dac0c99affe3f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787841778.364188:0:9449:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:3.0:1787841778.364193:0:9449:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787841778.364223:0:9449:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169ac00/0xe3dac0c99affe3f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841778.364239:0:9449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169a800/0xe3dac0c99affe3e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841778.364247:0:9449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169a800/0xe3dac0c99affe3e8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841778.364253:0:9449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169a800/0xe3dac0c99affe3e8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841778.364260:0:9449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc169a800 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:3.0:1787841778.364265:0:9449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169a800/0xe3dac0c99affe3e8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841778.364272:0:9449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169a800/0xe3dac0c99affe3e8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841778.364295:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92cbc89cdb00) 00010000:00010000:3.0:1787841778.364298:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787841778.364305:0:9449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169a800/0xe3dac0c99affe3e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841778.364312:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169a800/0xe3dac0c99affe3e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841778.364342:0:9449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169a200/0xe3dac0c99affe3ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841778.364358:0:9449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169a200/0xe3dac0c99affe3ef lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841778.364364:0:9449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169a200/0xe3dac0c99affe3ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841778.364370:0:9449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc169a200 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:3.0:1787841778.364373:0:9449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169a200/0xe3dac0c99affe3ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841778.364380:0:9449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169a200/0xe3dac0c99affe3ef lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841778.364387:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff92cbc89cd400) 00010000:00010000:3.0:1787841778.364390:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787841778.364392:0:9449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169a200/0xe3dac0c99affe3ef lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841778.364398:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169a200/0xe3dac0c99affe3ef lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841778.364451:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affe3e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d678e expref: 10 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841778.364468:0:9449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169ac00/0xe3dac0c99affe3f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d678e expref: 9 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841778.364476:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff92cbc89cde00) 00010000:00010000:3.0:1787841778.364478:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787841778.364481:0:9449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc169ac00, rc 0) 00000100:00100000:3.0:1787841778.364583:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd5acf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+9:9696:x1874687695014400:12345-192.168.201.1@tcp:101:chown.0 Request processed in 899us (1178us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841778.364592:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 19 00000100:00100000:0.0:1787841778.379358:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841778.379483:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695014656 00000100:00100000:2.0:1787841778.379497:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695014656 00000100:00100000:2.0:1787841778.379635:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 20 00000100:00100000:2.0:1787841778.379648:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd5ad680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+9:9696:x1874687695014656:12345-192.168.201.1@tcp:36:chown.0 00010000:00010000:2.0:1787841778.379784:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787841778.379825:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169ac00/0xe3dac0c99affe3f6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d678e expref: 9 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841778.379856:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff92cbc89cde00) 00010000:00010000:2.0:1787841778.379884:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787841778.379920:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599800/0xe3dac0c99affe3fd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841778.379937:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599800/0xe3dac0c99affe3fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841778.379950:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599800/0xe3dac0c99affe3fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787841778.462661:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000001:00080000:3.0:1787841778.462689:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:2.0:1787841778.465158:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000043aefdec reply state 0000000068df4663 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599800/0xe3dac0c99affe3fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841778.465176:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787841778.465588:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:2.0:1787841778.465808:0:5837:0:(ldlm_lib.c:3520:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1787841778.465838:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd5ad680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+7:9696:x1874687695014656:12345-192.168.201.1@tcp:36:chown.0 Request processed in 86186us (86502us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1787841778.465849:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 20 00010000:00010000:3.0:1787841778.465954:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599800/0xe3dac0c99affe3fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841778.465965:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599800/0xe3dac0c99affe3fd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841778.465974:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599800/0xe3dac0c99affe3fd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841778.465981:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6599800 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:3.0:1787841778.465988:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599800/0xe3dac0c99affe3fd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841778.465998:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599800/0xe3dac0c99affe3fd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841778.466032:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff92cbc3b04800) 00010000:00010000:3.0:1787841778.466035:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787841778.466042:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599800/0xe3dac0c99affe3fd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841778.466048:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599800/0xe3dac0c99affe3fd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841778.489016:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841778.489193:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695014784 00000100:00100000:1.0:1787841778.489211:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695014784 00000100:00100000:1.0:1787841778.489280:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 21 00000100:00100000:1.0:1787841778.489288:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd5af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2767a54-6703-4908-8414-eab6601e2ceb+6:9697:x1874687695014784:12345-192.168.201.1@tcp:101:touch.500 00010000:00010000:1.0:1787841778.489317:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841778.489342:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affe404 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6795 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787841778.491039:0:5838:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1625us 00010000:00010000:0.0:1787841778.516292:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725c00/0xe3dac0c99affe40b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841778.516317:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725c00/0xe3dac0c99affe40b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841778.516329:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725c00/0xe3dac0c99affe40b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841778.516345:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6724a00/0xe3dac0c99affe412 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841778.516361:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6724a00/0xe3dac0c99affe412 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841778.516368:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6724a00/0xe3dac0c99affe412 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841778.516880:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725200/0xe3dac0c99affe419 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841778.516890:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725200/0xe3dac0c99affe419 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841778.516898:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725200/0xe3dac0c99affe419 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787841778.516980:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787841778.516985:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787841778.517086:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725200/0xe3dac0c99affe419 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841778.517101:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725c00/0xe3dac0c99affe40b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841778.517107:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725c00/0xe3dac0c99affe40b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841778.517114:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725c00/0xe3dac0c99affe40b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841778.517120:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6725c00 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:0.0:1787841778.517125:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725c00/0xe3dac0c99affe40b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841778.517133:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725c00/0xe3dac0c99affe40b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841778.517145:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92cbc89cdb00) 00010000:00010000:0.0:1787841778.517153:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841778.517160:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725c00/0xe3dac0c99affe40b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841778.517166:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725c00/0xe3dac0c99affe40b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841778.517178:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6724a00/0xe3dac0c99affe412 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841778.517185:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6724a00/0xe3dac0c99affe412 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841778.517191:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6724a00/0xe3dac0c99affe412 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841778.517196:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6724a00 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:0.0:1787841778.517199:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6724a00/0xe3dac0c99affe412 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841778.517204:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6724a00/0xe3dac0c99affe412 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841778.517212:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff92cbc57e3500) 00010000:00010000:0.0:1787841778.517215:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841778.517218:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6724a00/0xe3dac0c99affe412 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841778.517223:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6724a00/0xe3dac0c99affe412 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841778.517262:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affe404 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6795 expref: 8 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841778.517288:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725200/0xe3dac0c99affe419 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6795 expref: 7 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841778.517296:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff92cbc57e3700) 00010000:00010000:0.0:1787841778.517298:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787841778.517300:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc6725200, rc 0) 00000100:00100000:0.0:1787841778.517392:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd5af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2767a54-6703-4908-8414-eab6601e2ceb+7:9697:x1874687695014784:12345-192.168.201.1@tcp:101:touch.500 Request processed in 28103us (28393us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841778.517402:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 21 00000100:00100000:1.0:1787841778.519934:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841778.520033:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695015040 00000100:00100000:3.0:1787841778.520043:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695015040 00000100:00100000:3.0:1787841778.520100:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 22 00000100:00100000:3.0:1787841778.520110:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd7a43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+7:9697:x1874687695015040:12345-192.168.201.1@tcp:101:touch.500 00010000:00010000:3.0:1787841778.520130:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841778.520302:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169a200/0xe3dac0c99affe420 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d679c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841778.520882:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169a800/0xe3dac0c99affe427 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841778.520898:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169a800/0xe3dac0c99affe427 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841778.520909:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169a800/0xe3dac0c99affe427 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841778.520923:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169b600/0xe3dac0c99affe42e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841778.520930:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169b600/0xe3dac0c99affe42e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841778.520947:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169b600/0xe3dac0c99affe42e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787841778.525993:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:3.0:1787841778.526760:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169ba00/0xe3dac0c99affe435 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841778.526780:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169ba00/0xe3dac0c99affe435 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841778.526793:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169ba00/0xe3dac0c99affe435 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841778.526837:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169a800/0xe3dac0c99affe427 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841778.526845:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169a800/0xe3dac0c99affe427 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841778.526852:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169a800/0xe3dac0c99affe427 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841778.526858:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc169a800 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:3.0:1787841778.526862:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169a800/0xe3dac0c99affe427 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841778.526870:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169a800/0xe3dac0c99affe427 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841778.526883:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff92cbc57e3700) 00010000:00010000:3.0:1787841778.526885:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787841778.526899:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169a800/0xe3dac0c99affe427 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841778.526906:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169a800/0xe3dac0c99affe427 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787841778.526920:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000318da086 reply state 00000000e35abbe3 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169b600/0xe3dac0c99affe42e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841778.526929:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787841778.526970:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169a200/0xe3dac0c99affe420 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d679c expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841778.526985:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169ba00/0xe3dac0c99affe435 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d679c expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841778.526993:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff92cbc89cd000) 00010000:00010000:3.0:1787841778.526995:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787841778.526998:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc169ba00, rc 0) 00000100:00100000:3.0:1787841778.527082:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd7a43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+10:9697:x1874687695015040:12345-192.168.201.1@tcp:101:touch.500 Request processed in 6973us (7157us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1787841778.527091:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 22 00010000:00010000:3.0:1787841778.536759:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169b600/0xe3dac0c99affe42e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841778.536778:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169b600/0xe3dac0c99affe42e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841778.536785:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169b600/0xe3dac0c99affe42e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841778.536811:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc169b600 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:3.0:1787841778.536816:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169b600/0xe3dac0c99affe42e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841778.536824:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169b600/0xe3dac0c99affe42e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841778.536834:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00010000:00010000:3.0:1787841778.536849:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xfd685d83 (ffff92cbc89cd400) 00010000:00010000:3.0:1787841778.536854:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787841778.536859:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169b600/0xe3dac0c99affe42e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841778.536864:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169b600/0xe3dac0c99affe42e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841778.537045:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695015296 00000100:00100000:0.0:1787841778.537056:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695015296 00000100:00100000:0.0:1787841778.537125:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 23 00000100:00100000:0.0:1787841778.537138:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbc9544000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+9:9697:x1874687695015296:12345-192.168.201.1@tcp:36:touch.500 00010000:00010000:0.0:1787841778.537210:0:9449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787841778.537228:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169ba00/0xe3dac0c99affe435 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d679c expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841778.537240:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff92cbc89cd000) 00010000:00010000:0.0:1787841778.537247:0:9449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787841778.537315:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6724a00/0xe3dac0c99affe443 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841778.537328:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6724a00/0xe3dac0c99affe443 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841778.537337:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6724a00/0xe3dac0c99affe443 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787841778.537497:0:9449:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d89d2de3 reply state 000000005face9ab transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6724a00/0xe3dac0c99affe443 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841778.537506:0:9449:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787841778.537602:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbc9544000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+10:9697:x1874687695015296:12345-192.168.201.1@tcp:36:touch.500 Request processed in 466us (775us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1787841778.537609:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 23 00000100:00100000:0.0:1787841778.543542:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00010000:00010000:3.0:1787841778.543550:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6724a00/0xe3dac0c99affe443 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841778.543566:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6724a00/0xe3dac0c99affe443 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841778.543575:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6724a00/0xe3dac0c99affe443 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841778.543582:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6724a00 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:3.0:1787841778.543587:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6724a00/0xe3dac0c99affe443 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841778.543596:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6724a00/0xe3dac0c99affe443 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841778.543623:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695015424 00000100:00100000:2.0:1787841778.543636:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695015424 00010000:00010000:3.0:1787841778.543640:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff92cbc57e3500) 00010000:00010000:3.0:1787841778.543645:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787841778.543652:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6724a00/0xe3dac0c99affe443 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841778.543659:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6724a00/0xe3dac0c99affe443 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841778.543726:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 24 00000100:00100000:2.0:1787841778.543744:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd5ae940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+9:9697:x1874687695015424:12345-192.168.201.1@tcp:101:touch.500 00010000:00010000:2.0:1787841778.543779:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841778.543797:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598c00/0xe3dac0c99affe44a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d67a3 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841778.543873:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598c00/0xe3dac0c99affe44a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d67a3 expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841778.543888:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598c00/0xe3dac0c99affe44a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d67a3 expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841778.543906:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff92cbc3b04300) 00010000:00010000:2.0:1787841778.543909:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787841778.543912:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc6598c00, rc 0) 00000100:00100000:2.0:1787841778.543973:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd5ae940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+10:9697:x1874687695015424:12345-192.168.201.1@tcp:101:touch.500 Request processed in 231us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841778.543981:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 24 00000100:00100000:1.0:1787841778.550083:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841778.550200:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695015552 00000100:00100000:2.0:1787841778.550211:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695015552 00000100:00100000:2.0:1787841778.550270:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 17 00000100:00100000:2.0:1787841778.550279:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd7a6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2353:x1874687695015552:12345-192.168.201.1@tcp:8:touch.500 00010000:00080000:2.0:1787841778.550325:0:6686:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from b2767a54-6703-4908-8414-eab6601e2ceb@192.168.201.1@tcp t0 exp 0000000000000000 cur 318 last 0 00000020:00000080:2.0:1787841778.550367:0:6686:0:(genops.c:1385:class_connect()) connect: client b2767a54-6703-4908-8414-eab6601e2ceb, cookie 0xe3dac0c99affe451 00002000:00100000:2.0:1787841778.550382:0:6686:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli b2767a54-6703-4908-8414-eab6601e2ceb/ffff92cac315c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211395f ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787841778.550418:0:6686:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787841778.550934:0:6686:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787841778.550981:0:6686:0:(import.c:65:import_set_state_nolock()) ffff92cac3158000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787841778.551058:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd7a6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b2767a54-6703-4908-8414-eab6601e2ceb+6:2353:x1874687695015552:12345-192.168.201.1@tcp:8:touch.500 Request processed in 777us (984us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841778.551067:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 17 00000100:00100000:0.0:1787841778.555663:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841778.556044:0:9572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695015680 00000100:00100000:1.0:1787841778.556069:0:9572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695015680 00000100:00100000:1.0:1787841778.556168:0:9572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 18 00000100:00100000:1.0:1787841778.556180:0:9572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf07f8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b2767a54-6703-4908-8414-eab6601e2ceb+6:0:x1874687695015680:12345-192.168.201.1@tcp:2:touch.500 00000100:00080000:2.0:1787841778.556511:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1787841778.625816:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00100000:3.0:1787841778.625837:0:6717:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b2767a54-6703-4908-8414-eab6601e2ceb 00000100:00100000:1.0:1787841778.625990:0:9572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf07f8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b2767a54-6703-4908-8414-eab6601e2ceb+5:0:x1874687695015680:12345-192.168.201.1@tcp:2:touch.500 Request processed in 69808us (70335us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1787841778.626000:0:9572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 18 00000100:00100000:2.0:1787841778.629568:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841778.629747:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695015936 00000100:00100000:1.0:1787841778.629760:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695015936 00000100:00100000:1.0:1787841778.629820:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 2 00000100:00100000:1.0:1787841778.629831:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbc9547480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b2767a54-6703-4908-8414-eab6601e2ceb+10:9697:x1874687695015936:12345-192.168.201.1@tcp:35:touch.500 00000100:00100000:1.0:1787841778.630251:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbc9547480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b2767a54-6703-4908-8414-eab6601e2ceb+11:9697:x1874687695015936:12345-192.168.201.1@tcp:35:touch.500 Request processed in 420us (695us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1787841778.630259:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 2 00000100:00100000:2.0:1787841778.667030:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841778.667415:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695016064 00000100:00100000:0.0:1787841778.667434:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695016064 00000100:00100000:0.0:1787841778.667500:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 25 00000100:00100000:0.0:1787841778.667512:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbc95470c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+11:9698:x1874687695016064:12345-192.168.201.1@tcp:101:rm.0 00010000:00010000:0.0:1787841778.667537:0:9449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841778.667559:0:9449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725400/0xe3dac0c99affe458 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d67aa expref: -99 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841778.667635:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725a00/0xe3dac0c99affe45f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841778.667651:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725a00/0xe3dac0c99affe45f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841778.667665:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725a00/0xe3dac0c99affe45f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787841778.667894:0:9449:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787841778.667899:0:9449:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787841778.667963:0:9449:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725a00/0xe3dac0c99affe45f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841778.667996:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725400/0xe3dac0c99affe458 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d67aa expref: 13 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841778.668015:0:9449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725a00/0xe3dac0c99affe45f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d67aa expref: 12 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841778.668024:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff92cbc57e3700) 00010000:00010000:0.0:1787841778.668027:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787841778.668031:0:9449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc6725a00, rc 0) 00000100:00100000:0.0:1787841778.669720:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbc95470c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+12:9698:x1874687695016064:12345-192.168.201.1@tcp:101:rm.0 Request processed in 2179us (2673us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841778.669734:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 25 00000100:00100000:3.0:1787841778.681564:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841778.681811:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695016320 00000100:00100000:2.0:1787841778.681821:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695016320 00000100:00100000:2.0:1787841778.681899:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 26 00000100:00100000:2.0:1787841778.681910:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e2bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+12:9698:x1874687695016320:12345-192.168.201.1@tcp:101:rm.0 00010000:00010000:2.0:1787841778.681932:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841778.681962:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599a00/0xe3dac0c99affe466 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d67b1 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787841778.682105:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1787841778.682279:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599a00/0xe3dac0c99affe466 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d67b1 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841778.682294:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92cbc89cdb00) 00010000:00010000:2.0:1787841778.682297:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787841778.682302:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599a00/0xe3dac0c99affe466 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d67b1 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841778.682317:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc6599a00, rc 0) 00000100:00100000:2.0:1787841778.682397:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e2bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+13:9698:x1874687695016320:12345-192.168.201.1@tcp:101:rm.0 Request processed in 488us (842us total) trans 4294967303 rc 301/301 00000100:00100000:2.0:1787841778.682405:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 26 00000100:00100000:2.0:1787841778.690311:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841778.690511:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695016448 00000100:00100000:1.0:1787841778.690523:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695016448 00000100:00100000:1.0:1787841778.690582:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 3 00000100:00100000:1.0:1787841778.690593:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff3ead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b2767a54-6703-4908-8414-eab6601e2ceb+13:9698:x1874687695016448:12345-192.168.201.1@tcp:37:rm.0 00000100:00100000:1.0:1787841778.702309:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff3ead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b2767a54-6703-4908-8414-eab6601e2ceb+13:9698:x1874687695016448:12345-192.168.201.1@tcp:37:rm.0 Request processed in 11707us (12001us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841778.702326:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 3 00000100:00100000:3.0:1787841778.711915:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841778.712289:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695016704 00000100:00100000:2.0:1787841778.712300:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695016704 00000100:00100000:2.0:1787841778.712371:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 4 00000100:00100000:2.0:1787841778.712382:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbc6c30c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b2767a54-6703-4908-8414-eab6601e2ceb+13:9698:x1874687695016704:12345-192.168.201.1@tcp:35:rm.0 00000100:00100000:2.0:1787841778.712740:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbc6c30c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b2767a54-6703-4908-8414-eab6601e2ceb+14:9698:x1874687695016704:12345-192.168.201.1@tcp:35:rm.0 Request processed in 317us (794us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1787841778.712750:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 4 00000100:00100000:2.0:1787841778.717368:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841778.717558:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695016960 00000100:00100000:0.0:1787841778.717570:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695016960 00000100:00100000:0.0:1787841778.717634:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 27 00000100:00100000:0.0:1787841778.717645:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff3ead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2767a54-6703-4908-8414-eab6601e2ceb+14:9698:x1874687695016960:12345-192.168.201.1@tcp:101:rm.0 00010000:00010000:0.0:1787841778.717674:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841778.717729:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725400/0xe3dac0c99affe474 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d67b8 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841778.718686:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6724400/0xe3dac0c99affe47b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841778.718736:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6724400/0xe3dac0c99affe47b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841778.718749:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6724400/0xe3dac0c99affe47b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787841778.718777:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1787841778.719688:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725400/0xe3dac0c99affe474 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d67b8 expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841778.719738:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6724400/0xe3dac0c99affe47b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d67b8 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841778.719747:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff92cbc57e3700) 00010000:00010000:0.0:1787841778.719750:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787841778.719753:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc6724400, rc 0) 00000100:00100000:0.0:1787841778.719833:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff3ead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2767a54-6703-4908-8414-eab6601e2ceb+16:9698:x1874687695016960:12345-192.168.201.1@tcp:101:rm.0 Request processed in 2189us (2474us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1787841778.719842:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 27 00000100:00100000:3.0:1787841778.724227:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841778.724321:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695017088 00000100:00100000:1.0:1787841778.724332:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695017088 00000100:00100000:1.0:1787841778.724412:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 28 00000100:00100000:1.0:1787841778.724431:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbc3dced00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+16:9698:x1874687695017088:12345-192.168.201.1@tcp:41:rm.0 00000004:00000024:1.0:1787841778.724504:0:5839:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:1.0:1787841778.724577:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbc3dced00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+16:9698:x1874687695017088:12345-192.168.201.1@tcp:41:rm.0 Request processed in 156us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841778.724585:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 28 00000100:00100000:3.0:1787841778.730090:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841778.731037:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695017216 00000100:00100000:1.0:1787841778.731210:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695017216 00000100:00100000:0.0:1787841778.731657:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 29 00000100:00100000:0.0:1787841778.731669:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbc3dcd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+16:9698:x1874687695017216:12345-192.168.201.1@tcp:101:rm.0 00010000:00010000:0.0:1787841778.731691:0:9449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841778.731732:0:9449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725400/0xe3dac0c99affe489 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d67bf expref: -99 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841778.731800:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6724a00/0xe3dac0c99affe490 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841778.731814:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6724a00/0xe3dac0c99affe490 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841778.731826:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6724a00/0xe3dac0c99affe490 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841778.731861:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6724c00/0xe3dac0c99affe497 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841778.731882:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6724c00/0xe3dac0c99affe497 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841778.731889:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6724c00/0xe3dac0c99affe497 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841778.732064:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725c00/0xe3dac0c99affe49e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841778.732073:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725c00/0xe3dac0c99affe49e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841778.732080:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725c00/0xe3dac0c99affe49e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787841778.732388:0:9449:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787841778.732402:0:9449:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787841778.732543:0:9449:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725c00/0xe3dac0c99affe49e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841778.732557:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725c00/0xe3dac0c99affe49e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841778.732566:0:9449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6724a00/0xe3dac0c99affe490 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841778.732572:0:9449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6724a00/0xe3dac0c99affe490 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841778.732588:0:9449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6724a00/0xe3dac0c99affe490 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841778.732595:0:9449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6724a00 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:0.0:1787841778.732601:0:9449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6724a00/0xe3dac0c99affe490 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841778.732608:0:9449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6724a00/0xe3dac0c99affe490 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841778.732621:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff92cbc57e3700) 00010000:00010000:0.0:1787841778.732624:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841778.732629:0:9449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6724a00/0xe3dac0c99affe490 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841778.732635:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6724a00/0xe3dac0c99affe490 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841778.732650:0:9449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6724c00/0xe3dac0c99affe497 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841778.732656:0:9449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6724c00/0xe3dac0c99affe497 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841778.732662:0:9449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6724c00/0xe3dac0c99affe497 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841778.732666:0:9449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6724c00 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:0.0:1787841778.732669:0:9449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6724c00/0xe3dac0c99affe497 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841778.732686:0:9449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6724c00/0xe3dac0c99affe497 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841778.732694:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xfd685d83 (ffff92cbc57e3300) 00010000:00010000:0.0:1787841778.732747:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841778.732751:0:9449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6724c00/0xe3dac0c99affe497 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841778.732757:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6724c00/0xe3dac0c99affe497 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841778.732793:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725400/0xe3dac0c99affe489 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d67bf expref: 18 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841778.732806:0:9449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725c00/0xe3dac0c99affe49e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d67bf expref: 17 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841778.732813:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff92cbc3b04300) 00010000:00010000:0.0:1787841778.732816:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787841778.732818:0:9449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc6725c00, rc 0) 00000100:00100000:0.0:1787841778.732895:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbc3dcd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+17:9698:x1874687695017216:12345-192.168.201.1@tcp:101:rm.0 Request processed in 1228us (2823us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841778.732903:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 29 00000100:00100000:0.0:1787841778.739320:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841778.739433:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695017472 00000100:00100000:1.0:1787841778.739444:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695017472 00000100:00100000:1.0:1787841778.739509:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 30 00000100:00100000:1.0:1787841778.739520:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd7a0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+17:9698:x1874687695017472:12345-192.168.201.1@tcp:36:rm.0 00010000:00010000:1.0:1787841778.739587:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787841778.739621:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725c00/0xe3dac0c99affe49e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d67bf expref: 17 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841778.739656:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598c00/0xe3dac0c99affe44a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d67a3 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841778.739668:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff92cbc3b04300) 00010000:00010000:1.0:1787841778.739686:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725a00/0xe3dac0c99affe45f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d67aa expref: 15 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841778.739694:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff92cbc57e3700) 00010000:00010000:1.0:1787841778.739733:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787841778.739761:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affe4a5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841778.739775:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affe4a5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841778.739786:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affe4a5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841778.739800:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c000/0xe3dac0c99affe4ac lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841778.739807:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c000/0xe3dac0c99affe4ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841778.739814:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c000/0xe3dac0c99affe4ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841778.739977:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d200/0xe3dac0c99affe4b3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841778.739995:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d200/0xe3dac0c99affe4b3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841778.740002:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d200/0xe3dac0c99affe4b3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787841778.744012:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:1.0:1787841778.744040:0:5839:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 318742341125ns, next at 319742336402ns, rc = 0 00010000:00010000:1.0:1787841778.744689:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9dc00/0xe3dac0c99affe4ba lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841778.744750:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9dc00/0xe3dac0c99affe4ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841778.744764:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9dc00/0xe3dac0c99affe4ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841778.744773:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9dc00/0xe3dac0c99affe4ba lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841778.744779:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9dc00/0xe3dac0c99affe4ba lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841778.744785:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9dc00/0xe3dac0c99affe4ba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841778.744812:0:5839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787841778.744840:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d200/0xe3dac0c99affe4b3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841778.744847:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d200/0xe3dac0c99affe4b3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841778.744870:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d200/0xe3dac0c99affe4b3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841778.744876:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cc00d9d200 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:1.0:1787841778.744880:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d200/0xe3dac0c99affe4b3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841778.744889:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d200/0xe3dac0c99affe4b3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841778.744902:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff92cbd1fc7800) 00010000:00010000:1.0:1787841778.744905:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787841778.744910:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d200/0xe3dac0c99affe4b3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841778.744916:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d200/0xe3dac0c99affe4b3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841778.744937:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affe4a5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841778.744944:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affe4a5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841778.744949:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affe4a5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841778.744954:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cc00d9d600 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:1.0:1787841778.744957:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affe4a5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841778.744972:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affe4a5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841778.744981:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff92cbc57e3700) 00010000:00010000:1.0:1787841778.744984:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787841778.744987:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affe4a5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841778.744992:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affe4a5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787841778.745002:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004b9bc52e reply state 00000000af7ccc26 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c000/0xe3dac0c99affe4ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841778.745011:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787841778.745138:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd7a0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+16:9698:x1874687695017472:12345-192.168.201.1@tcp:36:rm.0 Request processed in 5615us (5824us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1787841778.745147:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 30 00010000:00010000:3.0:1787841778.748629:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787841778.748648:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9dc00/0xe3dac0c99affe4ba lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841778.748661:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cc00d9dc00 already unused, calling callback (ffffffffc17a4500) 00010000:00010000:3.0:1787841778.748666:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9dc00/0xe3dac0c99affe4ba lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841778.748677:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9dc00/0xe3dac0c99affe4ba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841778.748695:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff92cbd1fc7800) 00010000:00010000:3.0:1787841778.748816:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787841778.748823:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9dc00/0xe3dac0c99affe4ba lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841778.748852:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9dc00/0xe3dac0c99affe4ba lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841778.749181:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841778.749186:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841778.749188:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841778.749491:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c000/0xe3dac0c99affe4ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841778.749502:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c000/0xe3dac0c99affe4ac lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841778.749508:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c000/0xe3dac0c99affe4ac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841778.749514:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cc00d9c000 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:1.0:1787841778.749519:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c000/0xe3dac0c99affe4ac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841778.749538:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c000/0xe3dac0c99affe4ac lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841778.749550:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xfd685d83 (ffff92cbd1fc7900) 00010000:00010000:1.0:1787841778.749553:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787841778.749556:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c000/0xe3dac0c99affe4ac lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841778.749563:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c000/0xe3dac0c99affe4ac lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841778.749783:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841778.749971:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695017728 00000100:00100000:2.0:1787841778.749982:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695017728 00000100:00100000:2.0:1787841778.750034:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 5 00000100:00100000:2.0:1787841778.750044:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd7a2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b2767a54-6703-4908-8414-eab6601e2ceb+15:9698:x1874687695017728:12345-192.168.201.1@tcp:35:rm.0 00000100:00100000:2.0:1787841778.750352:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd7a2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b2767a54-6703-4908-8414-eab6601e2ceb+16:9698:x1874687695017728:12345-192.168.201.1@tcp:35:rm.0 Request processed in 301us (565us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1787841778.750360:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 5 00000100:00100000:2.0:1787841778.755779:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841778.755945:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695017984 00000100:00100000:0.0:1787841778.755957:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695017984 00000100:00100000:0.0:1787841778.756026:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 31 00000100:00100000:0.0:1787841778.756055:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbc9547480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2767a54-6703-4908-8414-eab6601e2ceb+16:9698:x1874687695017984:12345-192.168.201.1@tcp:36:rm.0 00010000:00010000:0.0:1787841778.756134:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787841778.756163:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6724400/0xe3dac0c99affe47b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d67b8 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841778.756187:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725200/0xe3dac0c99affe419 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6795 expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841778.756199:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff92cbc57e3700) 00010000:00010000:0.0:1787841778.756217:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affe3da lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6787 expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841778.756225:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92cbc89cdb00) 00010000:00010000:0.0:1787841778.756232:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787841778.756256:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6724c00/0xe3dac0c99affe4c1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841778.756269:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6724c00/0xe3dac0c99affe4c1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841778.756279:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6724c00/0xe3dac0c99affe4c1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841778.756292:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725400/0xe3dac0c99affe4c8 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841778.756299:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725400/0xe3dac0c99affe4c8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841778.756305:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725400/0xe3dac0c99affe4c8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841778.757383:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725a00/0xe3dac0c99affe4cf lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841778.757399:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725a00/0xe3dac0c99affe4cf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841778.757408:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725a00/0xe3dac0c99affe4cf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787841778.761078:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1787841778.761105:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725a00/0xe3dac0c99affe4cf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841778.761116:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725a00/0xe3dac0c99affe4cf lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841778.761233:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725a00/0xe3dac0c99affe4cf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841778.761239:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6725a00 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:0.0:1787841778.761244:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725a00/0xe3dac0c99affe4cf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841778.761251:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725a00/0xe3dac0c99affe4cf lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841778.761268:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff92cbc57e3900) 00010000:00010000:0.0:1787841778.761271:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787841778.761276:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725a00/0xe3dac0c99affe4cf lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841778.761368:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725a00/0xe3dac0c99affe4cf lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841778.761544:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6724c00/0xe3dac0c99affe4c1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841778.761551:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6724c00/0xe3dac0c99affe4c1 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841778.761557:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6724c00/0xe3dac0c99affe4c1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841778.761563:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6724c00 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:0.0:1787841778.761566:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6724c00/0xe3dac0c99affe4c1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841778.761573:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6724c00/0xe3dac0c99affe4c1 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841778.761582:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92cbc57e3300) 00010000:00010000:0.0:1787841778.761585:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841778.761588:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6724c00/0xe3dac0c99affe4c1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841778.761594:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6724c00/0xe3dac0c99affe4c1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787841778.761607:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000684c8f63 reply state 00000000a4e9d58a transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725400/0xe3dac0c99affe4c8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841778.761616:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787841778.762173:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbc9547480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2767a54-6703-4908-8414-eab6601e2ceb+15:9698:x1874687695017984:12345-192.168.201.1@tcp:36:rm.0 Request processed in 6113us (6399us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1787841778.762185:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 31 00010000:00010000:3.0:1787841778.765907:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725400/0xe3dac0c99affe4c8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841778.765925:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725400/0xe3dac0c99affe4c8 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841778.765932:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725400/0xe3dac0c99affe4c8 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841778.765938:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6725400 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:3.0:1787841778.765943:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725400/0xe3dac0c99affe4c8 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841778.765951:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725400/0xe3dac0c99affe4c8 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841778.765969:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff92cbc57e3e00) 00010000:00010000:3.0:1787841778.765972:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787841778.765978:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725400/0xe3dac0c99affe4c8 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841778.765984:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725400/0xe3dac0c99affe4c8 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841779.264951:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787841779.968909:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf8dc9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874687714975104:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787841779.969022:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841779.969089:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787841779.969096:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbcd7a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3300:1874687714975232:0@lo:400:kworker.0 00000100:00100000:3.0:1787841779.969137:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841779.969177:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714975232 00000100:00100000:3.0:1787841779.969184:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714975232 00000100:00100000:3.0:1787841779.969230:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1787841779.969238:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe9a1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:3300:x1874687714975232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787841779.969288:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe9a1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:3300:x1874687714975232:12345-0@lo:400:kworker.0 Request processed in 50us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841779.969296:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1787841779.969355:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbcd7a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3300:1874687714975232:0@lo:400:kworker.0 00000100:00100000:1.0:1787841779.970182:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbcd7a2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874687714975360:0@lo:400:kworker.0 00000100:00100000:1.0:1787841779.970224:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841779.970254:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787841779.970260:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbcd7a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1874687714975488:0@lo:400:kworker.0 00000100:00100000:1.0:1787841779.970281:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841779.970307:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714975360 00000100:00100000:1.0:1787841779.970312:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714975360 00000100:00100000:1.0:1787841779.970357:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714975488 00000100:00100000:1.0:1787841779.970361:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714975488 00000100:00100000:1.0:1787841779.970390:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1787841779.970472:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd7a52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874687714975360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841779.970522:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd7a52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874687714975360:12345-0@lo:400:kworker.0 Request processed in 125us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841779.970529:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1787841779.970546:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1787841779.970552:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd7a7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1874687714975488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841779.970595:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd7a7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1874687714975488:12345-0@lo:400:kworker.0 Request processed in 43us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841779.970601:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:1.0:1787841779.970622:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787841779.970650:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbcd7a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1874687714975488:0@lo:400:kworker.0 00000100:00100000:1.0:1787841779.970662:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbcd7a2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874687714975360:0@lo:400:kworker.0 00000100:00100000:3.0:1787841779.970755:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbcd7a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874687714975616:0@lo:400:kworker.0 00000100:00100000:3.0:1787841779.970786:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841779.974554:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714975104 00000100:00100000:2.0:1787841779.974571:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714975104 00000100:00100000:1.0:1787841779.974603:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714975616 00000100:00100000:1.0:1787841779.974608:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714975616 00000100:00100000:1.0:1787841779.974657:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787841779.974668:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbc3dcf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1874687714975616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841779.974800:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbc3dcf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1874687714975616:12345-0@lo:400:kworker.0 Request processed in 133us (4011us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841779.974808:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:1.0:1787841779.974836:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787841779.974840:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787841779.975099:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbcd7a3c00 x1874687714975616/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787841795 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787841779.975117:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbcd7a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874687714975616:0@lo:400:kworker.0 00000100:00100000:2.0:1787841779.975361:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787841779.975364:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787841779.975472:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbc3dce940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874687714975104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787841779.975513:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787841779.978205:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbcd7a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1874687714975744:0@lo:400:kworker.0 00000100:00100000:1.0:1787841779.978374:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841779.978531:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714975744 00000100:00100000:0.0:1787841779.978540:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714975744 00000100:00100000:0.0:1787841779.978615:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787841779.978625:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd7a7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874687714975744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841779.978682:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd7a7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874687714975744:12345-0@lo:400:kworker.0 Request processed in 59us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841779.978690:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1787841779.978815:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbcd7a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1874687714975744:0@lo:400:kworker.0 00000100:00080000:3.0:1787841779.978874:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787841779.983259:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbc3dce940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874687714975104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 7866us (14212us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841779.983274:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:1.0:1787841779.990135:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbf8dc9a40 x1874687714975104/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841795 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787841779.990167:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf8dc9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874687714975104:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787841780.295940:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787841780.992964:0:6714:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 320991263031ns, next at 321991260869ns, rc = 0 00000100:00100000:0.0:1787841780.993052:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787841780.993077:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbcd7a5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874687714975872:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787841780.993165:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841780.993400:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714975872 00000100:00100000:3.0:1787841780.993408:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714975872 00000100:00100000:3.0:1787841780.993468:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787841780.993479:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd7a1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874687714975872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787841780.993518:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787841780.993574:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd7a1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874687714975872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841780.993600:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:1.0:1787841780.993810:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbcd7a5680 x1874687714975872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841796 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787841780.993837:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbcd7a5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874687714975872:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787841781.316477:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787841781.915374:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841781.915417:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841781.915440:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841781.915467:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841781.915501:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695018368 00000100:00100000:3.0:1787841781.915510:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695018368 00000100:00100000:3.0:1787841781.915566:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 52 00000100:00100000:3.0:1787841781.915577:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbc3dcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b2767a54-6703-4908-8414-eab6601e2ceb+5:2355:x1874687695018368:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:3.0:1787841781.915649:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbc3dcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b2767a54-6703-4908-8414-eab6601e2ceb+5:2355:x1874687695018368:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 74us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841781.915657:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 52 00000100:00080000:3.0:1787841781.915678:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787841781.917263:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695018240 00000100:00100000:1.0:1787841781.917273:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695018240 00000100:00100000:1.0:1787841781.917333:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695018496 00000100:00100000:1.0:1787841781.917336:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695018496 00000100:00100000:1.0:1787841781.917358:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 119 00000100:00100000:1.0:1787841781.917366:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbc3dcda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2767a54-6703-4908-8414-eab6601e2ceb+14:2354:x1874687695018240:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:1.0:1787841781.917429:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbc3dcda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2767a54-6703-4908-8414-eab6601e2ceb+14:2354:x1874687695018240:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 65us (2067us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841781.917436:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 119 00000100:00100000:1.0:1787841781.917450:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 120 00000100:00100000:1.0:1787841781.917456:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf8e83840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fe7d2185-ae43-428e-8bfa-909f60138853+5:2354:x1874687695018496:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:1.0:1787841781.917478:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf8e83840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fe7d2185-ae43-428e-8bfa-909f60138853+5:2354:x1874687695018496:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 22us (2010us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841781.917483:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 120 00000100:00100000:1.0:1787841781.917499:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695018112 00000100:00100000:1.0:1787841781.917502:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695018112 00000100:00100000:1.0:1787841781.917524:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 259 00000100:00100000:1.0:1787841781.917529:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe9a1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a1f1ce-26b5-4cc6-a1db-8e09063432da+13:2355:x1874687695018112:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:1.0:1787841781.917552:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe9a1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a1f1ce-26b5-4cc6-a1db-8e09063432da+13:2355:x1874687695018112:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 23us (2135us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841781.917557:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 259 00000100:00080000:3.0:1787841781.919309:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787841782.337577:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841783.361522:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787841783.611242:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:3.0:1787841783.611290:0:5860:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000004:00080000:3.0:1787841783.611309:0:5860:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:3.0:1787841783.615237:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787841783.615261:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf8dc9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687714976000:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787841783.615339:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841783.615507:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714976000 00000100:00100000:2.0:1787841783.615514:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714976000 00000100:00100000:2.0:1787841783.615579:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787841783.615587:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf8e80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1874687714976000:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1787841783.615612:0:6686:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:2.0:1787841783.615646:0:6686:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a904cf3, atime: 0x6a904cf3, ctime: 0x6a904cf3, blocks: 0x1 00010000:00010000:2.0:1787841783.615654:0:6686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000663e3de2/0xe3dac0c99affe4d6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841783.615670:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=323s v=(0 0) 00010000:00010000:2.0:1787841783.615674:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787841783.615681:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000663e3de2/0xe3dac0c99affe4d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841783.615727:0:6686:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000663e3de2/0xe3dac0c99affe4d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841783.615738:0:6686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000663e3de2/0xe3dac0c99affe4d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841783.615745:0:6686:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000663e3de2/0xe3dac0c99affe4d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841783.615762:0:6686:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:3.0:1787841783.616491:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787841783.616855:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787841783.616863:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000663e3de2/0xe3dac0c99affe4d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841783.616875:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6599800 already unused, calling callback (ffffffffc17a4500) 00010000:00010000:3.0:1787841783.616879:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000663e3de2/0xe3dac0c99affe4d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841783.616900:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000663e3de2/0xe3dac0c99affe4d6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841783.616922:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000663e3de2/0xe3dac0c99affe4d6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841783.616931:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000663e3de2/0xe3dac0c99affe4d6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841783.616972:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841783.616974:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841783.616975:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787841783.619610:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf8e80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3298:x1874687714976000:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4012us (4258us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1787841783.619624:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000004:00080000:3.0:1787841783.620216:0:3298:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff92cbf8dc9680/2, rc 0, transno 4294967300 00000100:00100000:3.0:1787841783.620224:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf8dc9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687714976000:0@lo:6:osp-syn-0-0.0 00000001:00080000:2.0:1787841784.151443:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:02000400:1.0:1787841784.318753:0:11617:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:0.0:1787841784.409794:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787841785.089237:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787841785.089275:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf8dcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874687714976128:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787841785.089347:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841785.089443:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714976128 00000100:00100000:1.0:1787841785.089462:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714976128 00000100:00100000:1.0:1787841785.089531:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787841785.089541:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf8e81a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874687714976128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787841785.089582:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787841785.089630:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf8e81a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874687714976128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841785.089637:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:2.0:1787841785.089972:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787841785.096057:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbf8dcb480 x1874687714976128/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841801 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787841785.096085:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf8dcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874687714976128:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787841785.096537:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787841785.096551:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf8e80b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3300:1874687714976256:0@lo:400:kworker.0 00000100:00100000:3.0:1787841785.096621:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841785.096671:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714976256 00000100:00100000:3.0:1787841785.096677:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714976256 00000100:00100000:3.0:1787841785.096862:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1787841785.096872:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe9a1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:3300:x1874687714976256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787841785.096939:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe9a1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:3300:x1874687714976256:12345-0@lo:400:kworker.0 Request processed in 68us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841785.096962:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1787841785.097023:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf8e80780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874687714976384:0@lo:400:kworker.0 00000100:00100000:3.0:1787841785.097052:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841785.097086:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714976384 00000100:00100000:3.0:1787841785.097090:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714976384 00000100:00100000:3.0:1787841785.097118:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1787841785.097125:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf8e83c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874687714976384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787841785.097161:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf8e83c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874687714976384:12345-0@lo:400:kworker.0 Request processed in 36us (108us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841785.097167:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1787841785.097196:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf8e80780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874687714976384:0@lo:400:kworker.0 00000100:00100000:3.0:1787841785.097253:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787841785.097260:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf8e80780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1874687714976512:0@lo:400:kworker.0 00000100:00100000:3.0:1787841785.097284:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841785.097327:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787841785.097334:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e64780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874687714976640:0@lo:400:kworker.0 00000100:00100000:3.0:1787841785.097361:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841785.097386:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714976640 00000100:00100000:2.0:1787841785.097388:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714976512 00000100:00100000:3.0:1787841785.097389:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714976640 00000100:00100000:2.0:1787841785.097391:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714976512 00000100:00100000:0.0:1787841785.097444:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf8e80b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3300:1874687714976256:0@lo:400:kworker.0 00000100:00100000:3.0:1787841785.098016:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787841785.098027:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e65680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1874687714976640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787841785.098075:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e65680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1874687714976640:12345-0@lo:400:kworker.0 Request processed in 52us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841785.098082:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787841785.101971:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1787841785.101987:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf8e81680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1874687714976512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841785.102089:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf8e81680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1874687714976512:12345-0@lo:400:kworker.0 Request processed in 107us (4804us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841785.102097:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1787841785.102149:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf8e80780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1874687714976512:0@lo:400:kworker.0 00000100:00080000:2.0:1787841785.102176:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787841785.102183:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787841785.103229:0:3301:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:3.0:1787841785.103261:0:3301:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff92cbf8dc9680, transno 4294967300 00000100:00100000:3.0:1787841785.103281:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e64780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874687714976640:0@lo:400:kworker.0 00000100:00100000:3.0:1787841785.103347:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e64780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1874687714976768:0@lo:400:kworker.0 00000100:00100000:3.0:1787841785.103394:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841785.103434:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714976768 00000100:00100000:3.0:1787841785.103440:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714976768 00000100:00100000:3.0:1787841785.103484:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1787841785.103496:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874687714976768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787841785.103543:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874687714976768:12345-0@lo:400:kworker.0 Request processed in 52us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841785.103549:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1787841785.103578:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e64780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1874687714976768:0@lo:400:kworker.0 00000100:00080000:2.0:1787841785.106594:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787841785.410502:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787841785.515670:0:11665:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffe9c8b9b0 20000000:00000080:2.0:1787841785.515690:0:11665:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff92cbcd5ab400 uarg=0000000000000000 20000000:01000000:2.0:1787841785.516005:0:11665:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1787841785.516083:0:11665:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1787841785.516089:0:11665:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:1.0:1787841785.517384:0:11666:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:2.0:1787841785.517569:0:11665:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:3.0:1787841785.529432:0:11665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:3.0:1787841785.529484:0:11665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:3.0:1787841785.529530:0:11665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:3.0:1787841785.529548:0:11665:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787841785.529570:0:11665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff92cbc169b600/0xe3dac0c99affe4dd lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841785.529594:0:11665:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92cbc6599c00/0xe3dac0c99affe378 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6772 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841785.529603:0:11665:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92cbc149de00/0xe3dac0c99affe37f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6779 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841785.529611:0:11665:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92cbc6725800/0xe3dac0c99affe38d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe3dac0c99affe386 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841785.529630:0:11665:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92cbc6724000/0xe3dac0c99affe39b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe3dac0c99affe394 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841785.529637:0:11665:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92cbc6724800/0xe3dac0c99affe3a9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe3dac0c99affe3a2 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841785.529645:0:11665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff92cbc169b600/0xe3dac0c99affe4dd lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841785.529690:0:11665:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92cbc6724800/0xe3dac0c99affe3a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe3dac0c99affe3a2 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841785.529766:0:11665:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92cbc6724800/0xe3dac0c99affe3a9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe3dac0c99affe3a2 expref: 18 pid: 5831 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841785.529781:0:11665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e64780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11665:1874687714976896:0@lo:104: 00000100:00100000:3.0:1787841785.529855:0:11665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787841785.530149:0:11665:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92cbc6724000/0xe3dac0c99affe39b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe3dac0c99affe394 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841785.530158:0:11665:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92cbc6724000/0xe3dac0c99affe39b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe3dac0c99affe394 expref: 18 pid: 5832 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841785.530166:0:11665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e66940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11665:1874687714977024:0@lo:104: 00000100:00100000:3.0:1787841785.530189:0:11665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787841785.530374:0:11665:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92cbc6725800/0xe3dac0c99affe38d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe3dac0c99affe386 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841785.530383:0:11665:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92cbc6725800/0xe3dac0c99affe38d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe3dac0c99affe386 expref: 18 pid: 5833 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841785.530399:0:11665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e67c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11665:1874687714977152:0@lo:104: 00000100:00100000:3.0:1787841785.530425:0:11665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787841785.535400:0:11665:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92cbc149de00/0xe3dac0c99affe37f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6779 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841785.535514:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714976896 00000100:00100000:2.0:1787841785.535522:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714976896 00000100:00100000:2.0:1787841785.535565:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714977024 00000100:00100000:2.0:1787841785.535568:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714977024 00000100:00100000:2.0:1787841785.535578:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714977152 00000100:00100000:2.0:1787841785.535581:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714977152 00000100:00100000:1.0:1787841785.535651:0:5821:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:3.0:1787841785.535743:0:11665:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92cbc149de00/0xe3dac0c99affe37f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6779 expref: 12 pid: 5832 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841785.535743:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787841785.535753:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e64f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+5:11665:x1874687714976896:12345-0@lo:104: 00000100:00100000:3.0:1787841785.535759:0:11665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4bb1680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11665:1874687714977280:192.168.201.1@tcp:104: 00010000:00010000:2.0:1787841785.535768:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.101@tcp lock: ffff92cbc6598a00/0xe3dac0c99affe3a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe3dac0c99affe3a9 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841785.535940:0:11665:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92cbc6599c00/0xe3dac0c99affe378 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6772 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841785.535950:0:11665:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92cbc6599c00/0xe3dac0c99affe378 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6772 expref: 12 pid: 5833 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841785.535959:0:11665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4bb0b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11665:1874687714977408:192.168.201.1@tcp:104: 00010000:00010000:2.0:1787841785.536982:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787841785.536992:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e64f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+5:11665:x1874687714976896:12345-0@lo:104: Request processed in 1240us (7136us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841785.537002:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787841785.537113:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787841785.537214:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e66d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+4:11665:x1874687714977024:12345-0@lo:104: 00010000:00010000:2.0:1787841785.537228:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.101@tcp lock: ffff92cbc149c400/0xe3dac0c99affe394 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe3dac0c99affe39b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841785.537285:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787841785.537291:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e66d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+4:11665:x1874687714977024:12345-0@lo:104: Request processed in 171us (7101us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841785.537298:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787841785.537311:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787841785.537317:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf7195050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+3:11665:x1874687714977152:12345-0@lo:104: 00010000:00010000:2.0:1787841785.537325:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.101@tcp lock: ffff92cbc149c000/0xe3dac0c99affe386 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe3dac0c99affe38d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841785.537353:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787841785.537357:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf7195050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+3:11665:x1874687714977152:12345-0@lo:104: Request processed in 41us (6932us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841785.537363:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:2.0:1787841785.537434:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787841785.537440:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.101@tcp lock: ffff92cbc6598a00/0xe3dac0c99affe3a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe3dac0c99affe3a9 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841785.537447:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6598a00 already unused, calling callback (ffffffffc1d9fc20) 10000000:00010000:2.0:1787841785.537451:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.101@tcp lock: ffff92cbc6598a00/0xe3dac0c99affe3a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xe3dac0c99affe3a9 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841785.537459:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.101@tcp lock: ffff92cbc6598a00/0xe3dac0c99affe3a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xe3dac0c99affe3a9 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787841785.537466:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.101@tcp lock: ffff92cbc6598a00/0xe3dac0c99affe3a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xe3dac0c99affe3a9 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787841785.537471:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787841785.537505:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.101@tcp lock: ffff92cbc6598a00/0xe3dac0c99affe3a2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99affe3a9 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841785.537511:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787841785.537530:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.101@tcp lock: ffff92cbc6598a00/0xe3dac0c99affe3a2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99affe3a9 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841785.537537:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.101@tcp lock: ffff92cbc6598a00/0xe3dac0c99affe3a2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99affe3a9 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841785.537549:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787841785.537552:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.101@tcp lock: ffff92cbc149c400/0xe3dac0c99affe394 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe3dac0c99affe39b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841785.537558:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc149c400 already unused, calling callback (ffffffffc1d9fc20) 10000000:00010000:2.0:1787841785.537561:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.101@tcp lock: ffff92cbc149c400/0xe3dac0c99affe394 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe3dac0c99affe39b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841785.537575:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.101@tcp lock: ffff92cbc149c400/0xe3dac0c99affe394 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe3dac0c99affe39b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787841785.537582:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.101@tcp lock: ffff92cbc149c400/0xe3dac0c99affe394 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe3dac0c99affe39b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787841785.537588:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787841785.537602:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.101@tcp lock: ffff92cbc149c400/0xe3dac0c99affe394 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99affe39b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841785.537608:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787841785.541772:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.101@tcp lock: ffff92cbc149c400/0xe3dac0c99affe394 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99affe39b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841785.541793:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.101@tcp lock: ffff92cbc149c400/0xe3dac0c99affe394 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99affe39b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841785.541818:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787841785.541822:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.101@tcp lock: ffff92cbc149c000/0xe3dac0c99affe386 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe3dac0c99affe38d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841785.541828:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc149c000 already unused, calling callback (ffffffffc1d9fc20) 10000000:00010000:2.0:1787841785.541833:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.101@tcp lock: ffff92cbc149c000/0xe3dac0c99affe386 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe3dac0c99affe38d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841785.541841:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.101@tcp lock: ffff92cbc149c000/0xe3dac0c99affe386 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe3dac0c99affe38d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787841785.541849:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.101@tcp lock: ffff92cbc149c000/0xe3dac0c99affe386 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe3dac0c99affe38d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787841785.541871:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787841785.541927:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.101@tcp lock: ffff92cbc149c000/0xe3dac0c99affe386 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99affe38d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841785.541933:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787841785.541961:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.101@tcp lock: ffff92cbc149c000/0xe3dac0c99affe386 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99affe38d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841785.541967:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.101@tcp lock: ffff92cbc149c000/0xe3dac0c99affe386 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99affe38d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841785.541980:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841785.541982:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841785.541984:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841785.542168:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787841785.542262:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf8dc8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3298:1874687714977536:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787841785.542415:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf8dc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3299:1874687714977664:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787841785.542449:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf8dcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3300:1874687714977792:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787841785.542471:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841785.542581:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714977792 00000100:00100000:0.0:1787841785.542589:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714977792 00010000:00010000:0.0:1787841785.542625:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92cbc6725800/0xe3dac0c99affe38d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe3dac0c99affe386 expref: 19 pid: 5833 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841785.542677:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787841785.542686:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf8dc9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:3300:x1874687714977792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787841785.542717:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787841785.542723:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92cbc6725800/0xe3dac0c99affe38d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe3dac0c99affe386 expref: 19 pid: 5833 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841785.542741:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92cbc6725800/0xe3dac0c99affe38d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe3dac0c99affe386 expref: 19 pid: 5833 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841785.542759:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787841785.542792:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf8dc9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:3300:x1874687714977792:12345-0@lo:103:ldlm_bl.0 Request processed in 108us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841785.542799:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787841785.543638:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841785.543937:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf8dcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3300:1874687714977792:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787841785.544803:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841785.544836:0:11665:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cc01d84cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787841785.544849:0:7633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695018624 00000100:00100000:3.0:1787841785.544853:0:11665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e64780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11665:1874687714976896:0@lo:104: 00000100:00100000:2.0:1787841785.544854:0:7633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695018624 00000100:00100000:3.0:1787841785.544862:0:11665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e66940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11665:1874687714977024:0@lo:104: 00010000:00010000:3.0:1787841785.544884:0:11665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92cbc6725800/0xe3dac0c99affe38d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe3dac0c99affe386 expref: 18 pid: 5833 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841785.544884:0:7633:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92cbc149de00/0xe3dac0c99affe37f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6779 expref: 13 pid: 5832 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841785.544899:0:11665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e67c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11665:1874687714977152:0@lo:104: 00000100:00100000:3.0:1787841785.544909:0:11665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4bb1680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11665:1874687714977280:192.168.201.1@tcp:104: 00000100:00100000:2.0:1787841785.544917:0:7633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714977664 00000100:00100000:2.0:1787841785.544920:0:7633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714977664 00010000:00010000:2.0:1787841785.544947:0:7633:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92cbc6724000/0xe3dac0c99affe39b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe3dac0c99affe394 expref: 18 pid: 5832 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841785.544974:0:7633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 31 00000100:00100000:0.0:1787841785.544979:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787841785.544981:0:7633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbd4bb21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09a1f1ce-26b5-4cc6-a1db-8e09063432da+13:2356:x1874687695018624:12345-192.168.201.1@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787841785.544987:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf8dcb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+18:3299:x1874687714977664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787841785.544995:0:7633:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787841785.544995:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787841785.545000:0:7633:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92cbc149de00/0xe3dac0c99affe37f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6779 expref: 13 pid: 5832 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841785.545001:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92cbc6724000/0xe3dac0c99affe39b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe3dac0c99affe394 expref: 18 pid: 5832 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841785.545011:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92cbc6724000/0xe3dac0c99affe39b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe3dac0c99affe394 expref: 18 pid: 5832 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841785.545020:0:7633:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92cbc149de00/0xe3dac0c99affe37f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6779 expref: 13 pid: 5832 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841785.545150:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841785.545176:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714977536 00000100:00100000:1.0:1787841785.545180:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714977536 00010000:00010000:1.0:1787841785.545194:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92cbc6724800/0xe3dac0c99affe3a9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe3dac0c99affe3a2 expref: 19 pid: 5831 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841785.545206:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787841785.545211:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcdb7b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:3298:x1874687714977536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787841785.545217:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787841785.545221:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92cbc6724800/0xe3dac0c99affe3a9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe3dac0c99affe3a2 expref: 19 pid: 5831 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841785.549603:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92cbc6724000/0xe3dac0c99affe39b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe3dac0c99affe394 expref: 19 pid: 5832 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841785.549609:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92cbc6724800/0xe3dac0c99affe3a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe3dac0c99affe3a2 expref: 19 pid: 5831 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841785.549623:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92cbc6724800/0xe3dac0c99affe3a9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe3dac0c99affe3a2 expref: 18 pid: 5831 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841785.549628:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787841785.549632:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787841785.549683:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92cbc149de00/0xe3dac0c99affe37f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6779 expref: 13 pid: 5832 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841785.549720:0:7633:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787841785.554971:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcdb7b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+17:3298:x1874687714977536:12345-0@lo:103:ldlm_bl.0 Request processed in 9747us (9809us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841785.555005:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787841785.555529:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf8dc8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3298:1874687714977536:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787841785.555888:0:7633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbd4bb21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09a1f1ce-26b5-4cc6-a1db-8e09063432da+12:2356:x1874687695018624:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 10903us (13859us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841785.555899:0:7633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 31 00000100:00100000:2.0:1787841785.556135:0:11665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4bb0b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11665:1874687714977408:192.168.201.1@tcp:104: 00010000:00010000:2.0:1787841785.556170:0:11665:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff92cbc169b600/0xe3dac0c99affe4dd lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841785.559183:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf8dcb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+16:3299:x1874687714977664:12345-0@lo:103:ldlm_bl.0 Request processed in 14187us (14371us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841785.559199:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787841785.561613:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841785.561678:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695018752 00000100:00100000:1.0:1787841785.561688:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695018752 00010000:00010000:1.0:1787841785.561746:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92cbc6599c00/0xe3dac0c99affe378 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6772 expref: 12 pid: 5833 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841785.561779:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 34 00000100:00100000:1.0:1787841785.561788:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf8dcb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09a1f1ce-26b5-4cc6-a1db-8e09063432da+12:2357:x1874687695018752:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787841785.561803:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787841785.561808:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92cbc6599c00/0xe3dac0c99affe378 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6772 expref: 12 pid: 5833 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841785.561822:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92cbc6599c00/0xe3dac0c99affe378 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6772 expref: 12 pid: 5833 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841785.561841:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92cbc6599c00/0xe3dac0c99affe378 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6772 expref: 12 pid: 5833 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841785.561858:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff92cbc169b600/0xe3dac0c99affe4dd lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841785.561866:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92cbc169b600/0xe3dac0c99affe4dd lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841785.561883:0:5824:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92cbc169b600/0xe3dac0c99affe4dd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841785.561890:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92cbc169b600/0xe3dac0c99affe4dd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841785.561911:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff92cbc169b600/0xe3dac0c99affe4dd lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841785.561918:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff92cbc169b600/0xe3dac0c99affe4dd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841785.561925:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc169b600 already unused, calling callback (ffffffffc17a4500) 00010000:00010000:1.0:1787841785.561929:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff92cbc169b600/0xe3dac0c99affe4dd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841785.561937:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff92cbc169b600/0xe3dac0c99affe4dd lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841785.561950:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff92cbc169b600/0xe3dac0c99affe4dd lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841785.561960:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787841785.562027:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf8dcb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:09a1f1ce-26b5-4cc6-a1db-8e09063432da+11:2357:x1874687695018752:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 240us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841785.562035:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 34 00010000:00010000:2.0:1787841785.562162:0:11665:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff92cbc169b600/0xe3dac0c99affe4dd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841785.562170:0:11665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff92cbc169b600/0xe3dac0c99affe4dd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841785.562186:0:11665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92cbc169b600/0xe3dac0c99affe4dd lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841785.564673:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf8dc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3299:1874687714977664:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787841786.114189:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbcd7a5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874687714977920:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787841786.114317:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841786.114447:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714977920 00000100:00100000:1.0:1787841786.114456:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714977920 00000100:00100000:1.0:1787841786.114519:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787841786.114531:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf8dc8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874687714977920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787841786.114574:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787841786.114631:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf8dc8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874687714977920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841786.114646:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787841786.115050:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbcd7a5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874687714977920:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787841786.432981:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787841786.816885:0:5836:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787841786.816892:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92cbff856800 from 7 10000000:01000000:2.0:1787841786.820100:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787841786.820164:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc6598a00/0xe3dac0c99affe4e4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841786.820176:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff92cbc6598a00/0xe3dac0c99affe4e4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841786.820188:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff92cbc6598a00/0xe3dac0c99affe4e4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841786.820487:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf8dc9680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714978048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787841786.820568:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841786.820691:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbd1ff9c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787841786.825058:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714978048 00000100:00100000:1.0:1787841786.825075:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714978048 00000100:00100000:1.0:1787841786.825150:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1787841786.825160:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe9a1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+16:5836:x1874687714978048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787841786.825178:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841786.825217:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92cc00d9cc00/0xe3dac0c99affe4eb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe3dac0c99affe4e4 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841786.825247:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92cc00d9cc00/0xe3dac0c99affe4eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe3dac0c99affe4e4 expref: 17 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841786.825258:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92cc00d9cc00/0xe3dac0c99affe4eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe3dac0c99affe4e4 expref: 17 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841786.825267:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cc00d9cc00, rc 0) 00000100:00100000:1.0:1787841786.825366:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe9a1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+17:5836:x1874687714978048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 207us (4796us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841786.825373:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1787841786.826944:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf8dc9680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714978048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787841786.826972:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff92cbc6598a00/0xe3dac0c99affe4e4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe4eb expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841786.826984:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff92cbc6598a00/0xe3dac0c99affe4e4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe3dac0c99affe4eb expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841786.827089:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf8dc9680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714978176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787841786.827141:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841786.827185:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbd1ff9c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787841786.827240:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714978176 00000100:00100000:3.0:1787841786.827247:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714978176 00000100:00100000:3.0:1787841786.827298:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1787841786.827307:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe9a1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+17:5836:x1874687714978176:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787841786.827563:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe9a1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+17:5836:x1874687714978176:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 257us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841786.827570:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1787841786.828918:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf8dc9680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714978176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787841786.828969:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf8dc9680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714978304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787841786.829040:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841786.829081:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbd1ff9c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787841786.829393:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714978304 00000100:00100000:1.0:1787841786.829400:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714978304 00000100:00100000:1.0:1787841786.829463:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1787841786.829472:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe9a19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+17:5836:x1874687714978304:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787841786.829967:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe9a19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+17:5836:x1874687714978304:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 494us (925us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841786.829974:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1787841786.831413:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf8dc9680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714978304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787841786.832957:0:11678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf8dc9680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f6e7591a-84a0-4774-9d28-b3ed28591dc5:11678:1874687714978432:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787841786.833151:0:11678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841786.833195:0:11678:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbd1ff9840 going to sleep for 11 seconds 00000100:00100000:0.0:1787841786.833259:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714978432 00000100:00100000:0.0:1787841786.833266:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714978432 00000100:00100000:0.0:1787841786.833318:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1787841786.833328:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe9a1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+17:11678:x1874687714978432:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787841786.833572:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe9a1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+17:11678:x1874687714978432:12345-0@lo:502:llog_process_th.0 Request processed in 244us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841786.833580:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1787841786.833731:0:11678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf8dc9680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f6e7591a-84a0-4774-9d28-b3ed28591dc5:11678:1874687714978432:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787841786.833761:0:11678:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787841786.833771:0:11678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787841786.833773:0:11678:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787841786.833780:0:11678:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff92cbff856800 00000020:00000080:2.0:1787841786.833782:0:11678:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787841786.833867:0:11678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf8dc9680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f6e7591a-84a0-4774-9d28-b3ed28591dc5:11678:1874687714978560:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787841786.833903:0:11678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841786.833934:0:11678:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbd1ff9840 going to sleep for 11 seconds 00000100:00100000:3.0:1787841786.834008:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714978560 00000100:00100000:3.0:1787841786.834014:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714978560 00000100:00100000:3.0:1787841786.834051:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1787841786.834058:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe9a19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+17:11678:x1874687714978560:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787841786.834204:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe9a19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+17:11678:x1874687714978560:12345-0@lo:502:llog_process_th.0 Request processed in 137us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841786.834220:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1787841786.834738:0:11678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf8dc9680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f6e7591a-84a0-4774-9d28-b3ed28591dc5:11678:1874687714978560:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787841786.834762:0:11678:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787841786.834769:0:11678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787841786.834778:0:11678:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1787841786.834782:0:11678:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1787841786.848887:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1787841786.848929:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787841786.848941:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc6598a00/0xe3dac0c99affe4e4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe4eb expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841786.848953:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff92cbc6598a00/0xe3dac0c99affe4e4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe4eb expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787841786.848963:0:5836:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787841786.848965:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92cbf04e3800 from 7 10000000:01000000:0.0:1787841786.848968:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787841786.849015:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc6724000/0xe3dac0c99affe4f2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841786.849031:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff92cbc6724000/0xe3dac0c99affe4f2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841786.849042:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff92cbc6724000/0xe3dac0c99affe4f2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841786.849068:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbcd7a21c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714978688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787841786.849135:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841786.849176:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc2e59240 going to sleep for 11 seconds 00000100:00100000:3.0:1787841786.854201:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714978688 00000100:00100000:3.0:1787841786.854227:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714978688 00000100:00100000:3.0:1787841786.854323:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1787841786.854334:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe9a18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+17:5836:x1874687714978688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787841786.854354:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841786.854373:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92cbc169a200/0xe3dac0c99affe4f9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe3dac0c99affe4f2 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841786.854403:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92cbc169a200/0xe3dac0c99affe4f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe3dac0c99affe4f2 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841786.854414:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92cbc169a200/0xe3dac0c99affe4f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe3dac0c99affe4f2 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841786.854443:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc169a200, rc 0) 00000100:00100000:3.0:1787841786.854536:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe9a18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+18:5836:x1874687714978688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 205us (5400us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841786.854544:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1787841786.854567:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbcd7a21c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714978688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787841786.854589:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff92cbc6724000/0xe3dac0c99affe4f2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe4f9 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841786.854607:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff92cbc6724000/0xe3dac0c99affe4f2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe3dac0c99affe4f9 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841786.854720:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbcd7a21c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714978816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787841786.854759:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841786.854794:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc2e59240 going to sleep for 11 seconds 00000100:00100000:3.0:1787841786.855300:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714978816 00000100:00100000:3.0:1787841786.855306:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714978816 00000100:00100000:3.0:1787841786.855341:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1787841786.855348:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe9a1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+18:5836:x1874687714978816:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787841786.855612:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe9a1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+18:5836:x1874687714978816:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 263us (851us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841786.855630:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1787841786.855726:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbcd7a21c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714978816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787841786.855762:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbcd7a21c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714978944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787841786.855804:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841786.855830:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc2e59240 going to sleep for 11 seconds 00000100:00100000:3.0:1787841786.855890:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714978944 00000100:00100000:3.0:1787841786.855896:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714978944 00000100:00100000:3.0:1787841786.855918:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1787841786.855925:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe9a1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+18:5836:x1874687714978944:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787841786.856092:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe9a1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+18:5836:x1874687714978944:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 167us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841786.856099:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1787841786.856158:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbcd7a21c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714978944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787841786.856532:0:11681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbcd7a5e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f6e7591a-84a0-4774-9d28-b3ed28591dc5:11681:1874687714979072:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787841786.856569:0:11681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841786.856597:0:11681:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cac3324cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787841786.856737:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714979072 00000100:00100000:3.0:1787841786.856742:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714979072 00000100:00100000:3.0:1787841786.856769:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1787841786.856776:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe9a18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+18:11681:x1874687714979072:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787841786.856918:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe9a18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+18:11681:x1874687714979072:12345-0@lo:502:llog_process_th.0 Request processed in 143us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841786.856925:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1787841786.857267:0:11681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbcd7a5e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f6e7591a-84a0-4774-9d28-b3ed28591dc5:11681:1874687714979072:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787841786.857294:0:11681:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787841786.857304:0:11681:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787841786.857306:0:11681:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787841786.857313:0:11681:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff92cbf04e3800 00000020:00000080:1.0:1787841786.857316:0:11681:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787841786.857398:0:11681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbcd7a5e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f6e7591a-84a0-4774-9d28-b3ed28591dc5:11681:1874687714979200:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787841786.857433:0:11681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841786.857464:0:11681:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cac3324cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787841786.857510:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714979200 00000100:00100000:3.0:1787841786.857514:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714979200 00000100:00100000:3.0:1787841786.857544:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1787841786.857550:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe9a18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+18:11681:x1874687714979200:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787841786.857761:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe9a18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+18:11681:x1874687714979200:12345-0@lo:502:llog_process_th.0 Request processed in 210us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841786.857769:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1787841786.857846:0:11681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbcd7a5e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f6e7591a-84a0-4774-9d28-b3ed28591dc5:11681:1874687714979200:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787841786.857864:0:11681:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787841786.857868:0:11681:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787841786.857870:0:11681:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1787841786.857874:0:11681:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1787841786.858022:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1787841786.858362:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787841786.858373:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc6724000/0xe3dac0c99affe4f2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe4f9 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841786.858383:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff92cbc6724000/0xe3dac0c99affe4f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe4f9 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787841786.858394:0:5836:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787841786.858397:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92cbc3ed8000 from 7 10000000:01000000:3.0:1787841786.858400:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787841786.858428:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc169a800/0xe3dac0c99affe500 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841786.858435:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff92cbc169a800/0xe3dac0c99affe500 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841786.858444:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff92cbc169a800/0xe3dac0c99affe500 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841786.858459:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4bb21c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714979328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787841786.858494:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841786.858538:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbcd629840 going to sleep for 11 seconds 00000100:00100000:1.0:1787841786.858584:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714979328 00000100:00100000:1.0:1787841786.858589:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714979328 00000100:00100000:1.0:1787841786.858690:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1787841786.858724:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe9a19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+18:5836:x1874687714979328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787841786.858736:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841786.858749:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92cc00d9ce00/0xe3dac0c99affe507 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe3dac0c99affe500 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841786.858771:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92cc00d9ce00/0xe3dac0c99affe507 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe3dac0c99affe500 expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841786.858782:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92cc00d9ce00/0xe3dac0c99affe507 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe3dac0c99affe500 expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841786.858791:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cc00d9ce00, rc 0) 00000100:00100000:1.0:1787841786.858835:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe9a19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:5836:x1874687714979328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841786.858841:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1787841786.858876:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4bb21c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714979328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787841786.858888:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff92cbc169a800/0xe3dac0c99affe500 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe507 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841786.858896:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff92cbc169a800/0xe3dac0c99affe500 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe3dac0c99affe507 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841786.858938:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbcd7a5e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714979456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787841786.858967:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841786.858981:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cac3324240 going to sleep for 11 seconds 00000100:00100000:1.0:1787841786.858992:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714979456 00000100:00100000:1.0:1787841786.858995:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714979456 00000100:00100000:1.0:1787841786.859951:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1787841786.859963:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe9a18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:5836:x1874687714979456:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787841786.860538:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe9a18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:5836:x1874687714979456:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 575us (1567us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841786.860546:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1787841786.860953:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbcd7a5e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714979456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787841786.861000:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4bb0b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714979584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787841786.861160:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841786.861196:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbcd629f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787841786.861259:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714979584 00000100:00100000:0.0:1787841786.861265:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714979584 00000100:00100000:0.0:1787841786.861302:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1787841786.861310:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:5836:x1874687714979584:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787841786.861464:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:5836:x1874687714979584:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 155us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841786.861471:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1787841786.861509:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4bb0b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f6e7591a-84a0-4774-9d28-b3ed28591dc5:5836:1874687714979584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787841786.862750:0:11683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbcd7a21c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f6e7591a-84a0-4774-9d28-b3ed28591dc5:11683:1874687714979712:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787841786.862814:0:11683:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841786.862854:0:11683:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc2e59a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787841786.862861:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714979712 00000100:00100000:2.0:1787841786.862867:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714979712 00000100:00100000:2.0:1787841786.862906:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1787841786.862914:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:11683:x1874687714979712:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787841786.863126:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:11683:x1874687714979712:12345-0@lo:502:llog_process_th.0 Request processed in 213us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841786.863133:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1787841786.863333:0:11683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbcd7a21c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f6e7591a-84a0-4774-9d28-b3ed28591dc5:11683:1874687714979712:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787841786.863366:0:11683:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787841786.863376:0:11683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787841786.863379:0:11683:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787841786.863386:0:11683:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff92cbc3ed8000 00000020:00000080:3.0:1787841786.863389:0:11683:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787841786.863470:0:11683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4bb1680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f6e7591a-84a0-4774-9d28-b3ed28591dc5:11683:1874687714979840:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787841786.863505:0:11683:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841786.863522:0:11683:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbcd629f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787841786.863920:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714979840 00000100:00100000:2.0:1787841786.863926:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714979840 00000100:00100000:2.0:1787841786.863958:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1787841786.863965:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:11683:x1874687714979840:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787841786.864144:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:11683:x1874687714979840:12345-0@lo:502:llog_process_th.0 Request processed in 178us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841786.864152:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1787841786.864218:0:11683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4bb1680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f6e7591a-84a0-4774-9d28-b3ed28591dc5:11683:1874687714979840:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787841786.864245:0:11683:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787841786.864251:0:11683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787841786.864253:0:11683:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1787841786.864257:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1787841786.864322:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1787841786.864340:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787841786.864350:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc169a800/0xe3dac0c99affe500 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe507 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841786.864360:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff92cbc169a800/0xe3dac0c99affe500 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe507 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787841786.866163:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787841787.023540:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841787.023654:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841787.024161:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841787.024307:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841787.024334:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695019136 00000100:00100000:1.0:1787841787.024343:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695019136 00000100:00100000:1.0:1787841787.024406:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 54 00000100:00100000:1.0:1787841787.024429:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd7a5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b2767a54-6703-4908-8414-eab6601e2ceb+5:2357:x1874687695019136:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:1.0:1787841787.024504:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd7a5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b2767a54-6703-4908-8414-eab6601e2ceb+5:2357:x1874687695019136:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 77us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841787.024513:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 54 00000100:00080000:1.0:1787841787.024536:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787841787.025606:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695019008 00000100:00100000:2.0:1787841787.025622:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695019008 00000100:00100000:2.0:1787841787.025721:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695019264 00000100:00100000:2.0:1787841787.025725:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695019264 00000100:00100000:2.0:1787841787.025755:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 124 00000100:00100000:2.0:1787841787.025764:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd7a4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+5:2357:x1874687695019008:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:2.0:1787841787.025831:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd7a4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+5:2357:x1874687695019008:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 69us (2303us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841787.025839:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 124 00000100:00100000:2.0:1787841787.025855:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 125 00000100:00100000:2.0:1787841787.025861:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd7a5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fe7d2185-ae43-428e-8bfa-909f60138853+5:2357:x1874687695019264:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:2.0:1787841787.025885:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd7a5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fe7d2185-ae43-428e-8bfa-909f60138853+5:2357:x1874687695019264:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 24us (2231us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841787.025891:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 125 00000100:00080000:1.0:1787841787.026587:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787841787.027381:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695018880 00000100:00100000:0.0:1787841787.027391:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695018880 00000100:00100000:0.0:1787841787.027450:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 276 00000100:00100000:0.0:1787841787.027458:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a1f1ce-26b5-4cc6-a1db-8e09063432da+11:2357:x1874687695018880:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:0.0:1787841787.027519:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a1f1ce-26b5-4cc6-a1db-8e09063432da+11:2357:x1874687695018880:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 62us (3359us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841787.027527:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 276 00010000:00010000:0.0:1787841787.457334:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787841787.482142:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841787.482358:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695019392 00000100:00100000:0.0:1787841787.482370:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695019392 00000100:00100000:0.0:1787841787.482440:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 277 00000100:00100000:0.0:1787841787.482450:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a1f1ce-26b5-4cc6-a1db-8e09063432da+11:5607:x1874687695019392:12345-192.168.201.1@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787841787.482468:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841787.482496:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92cbc6725200/0xe3dac0c99affe50e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d67c6 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841787.482530:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92cbc6725200/0xe3dac0c99affe50e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d67c6 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841787.482543:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92cbc6725200/0xe3dac0c99affe50e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d67c6 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841787.482553:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc6725200, rc 0) 00000100:00100000:0.0:1787841787.482632:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a1f1ce-26b5-4cc6-a1db-8e09063432da+12:5607:x1874687695019392:12345-192.168.201.1@tcp:101:ll_cfg_requeue.0 Request processed in 183us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841787.482639:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 277 00000100:00100000:1.0:1787841787.488663:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841787.488903:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695019520 00000100:00100000:2.0:1787841787.488913:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695019520 00000100:00100000:2.0:1787841787.489002:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 278 00000100:00100000:2.0:1787841787.489013:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a1f1ce-26b5-4cc6-a1db-8e09063432da+12:5607:x1874687695019520:12345-192.168.201.1@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787841787.489585:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a1f1ce-26b5-4cc6-a1db-8e09063432da+12:5607:x1874687695019520:12345-192.168.201.1@tcp:501:ll_cfg_requeue.0 Request processed in 573us (931us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841787.489594:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 278 00000100:00100000:3.0:1787841787.492828:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841787.493426:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695019648 00000100:00100000:2.0:1787841787.493438:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695019648 00000100:00100000:2.0:1787841787.493500:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 279 00000100:00100000:2.0:1787841787.493510:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a1f1ce-26b5-4cc6-a1db-8e09063432da+12:5607:x1874687695019648:12345-192.168.201.1@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787841787.493822:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a1f1ce-26b5-4cc6-a1db-8e09063432da+12:5607:x1874687695019648:12345-192.168.201.1@tcp:503:ll_cfg_requeue.0 Request processed in 312us (1005us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841787.493830:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 279 00000100:00100000:1.0:1787841787.497732:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841787.497848:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695019776 00000100:00100000:0.0:1787841787.497860:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695019776 00000100:00100000:0.0:1787841787.497944:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 280 00000100:00100000:0.0:1787841787.497954:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a1f1ce-26b5-4cc6-a1db-8e09063432da+12:9969:x1874687695019776:12345-192.168.201.1@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787841787.498572:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a1f1ce-26b5-4cc6-a1db-8e09063432da+12:9969:x1874687695019776:12345-192.168.201.1@tcp:502:llog_process_th.0 Request processed in 616us (880us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841787.498582:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 280 00000100:00100000:1.0:1787841787.515572:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841787.516556:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695019904 00000100:00100000:3.0:1787841787.516568:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695019904 00000100:00100000:3.0:1787841787.516628:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 281 00000100:00100000:3.0:1787841787.516639:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a1f1ce-26b5-4cc6-a1db-8e09063432da+12:9969:x1874687695019904:12345-192.168.201.1@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787841787.516929:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a1f1ce-26b5-4cc6-a1db-8e09063432da+12:9969:x1874687695019904:12345-192.168.201.1@tcp:502:llog_process_th.0 Request processed in 291us (1369us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841787.516937:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 281 00000100:00100000:3.0:1787841787.531500:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841787.532010:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695020032 00000100:00100000:2.0:1787841787.532024:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695020032 00000100:00100000:2.0:1787841787.532084:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 282 00000100:00100000:2.0:1787841787.532096:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a1f1ce-26b5-4cc6-a1db-8e09063432da+12:5607:x1874687695020032:12345-192.168.201.1@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787841787.532113:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841787.532132:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92cbc6599c00/0xe3dac0c99affe515 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d67cd expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841787.532163:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92cbc6599c00/0xe3dac0c99affe515 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d67cd expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841787.532174:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92cbc6599c00/0xe3dac0c99affe515 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d67cd expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841787.532183:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc6599c00, rc 0) 00000100:00100000:2.0:1787841787.532263:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a1f1ce-26b5-4cc6-a1db-8e09063432da+13:5607:x1874687695020032:12345-192.168.201.1@tcp:101:ll_cfg_requeue.0 Request processed in 170us (778us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841787.532270:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 282 00000100:00100000:1.0:1787841787.549286:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841787.549452:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695020160 00000100:00100000:0.0:1787841787.549464:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695020160 00000100:00100000:0.0:1787841787.549527:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 283 00000100:00100000:0.0:1787841787.549538:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a1f1ce-26b5-4cc6-a1db-8e09063432da+13:5607:x1874687695020160:12345-192.168.201.1@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787841787.549891:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a1f1ce-26b5-4cc6-a1db-8e09063432da+13:5607:x1874687695020160:12345-192.168.201.1@tcp:501:ll_cfg_requeue.0 Request processed in 354us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841787.549899:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 283 00000100:00100000:1.0:1787841787.553069:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841787.553225:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695020288 00000100:00100000:2.0:1787841787.553236:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695020288 00000100:00100000:2.0:1787841787.553308:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 284 00000100:00100000:2.0:1787841787.553318:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a1f1ce-26b5-4cc6-a1db-8e09063432da+13:5607:x1874687695020288:12345-192.168.201.1@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787841787.553555:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a1f1ce-26b5-4cc6-a1db-8e09063432da+13:5607:x1874687695020288:12345-192.168.201.1@tcp:503:ll_cfg_requeue.0 Request processed in 238us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841787.553570:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 284 00000100:00100000:1.0:1787841787.558618:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841787.558743:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695020416 00000100:00100000:3.0:1787841787.558753:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695020416 00000100:00100000:3.0:1787841787.558815:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 285 00000100:00100000:3.0:1787841787.558826:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a1f1ce-26b5-4cc6-a1db-8e09063432da+13:9972:x1874687695020416:12345-192.168.201.1@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787841787.559110:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a1f1ce-26b5-4cc6-a1db-8e09063432da+13:9972:x1874687695020416:12345-192.168.201.1@tcp:502:llog_process_th.0 Request processed in 284us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841787.559118:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 285 00000100:00100000:1.0:1787841787.565249:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841787.565683:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695020544 00000100:00100000:0.0:1787841787.565691:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695020544 00000100:00100000:0.0:1787841787.565830:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 286 00000100:00100000:0.0:1787841787.565837:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a1f1ce-26b5-4cc6-a1db-8e09063432da+13:9972:x1874687695020544:12345-192.168.201.1@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787841787.566097:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a1f1ce-26b5-4cc6-a1db-8e09063432da+13:9972:x1874687695020544:12345-192.168.201.1@tcp:502:llog_process_th.0 Request processed in 259us (865us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841787.566106:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 286 00000040:00080000:0.0:1787841787.905385:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787841788.481109:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841789.504916:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787841790.209001:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf8dc9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687714979968:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787841790.209107:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841790.209622:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff4d7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874687714980224:0@lo:400:kworker.0 00000100:00100000:1.0:1787841790.209670:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841790.209695:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787841790.209726:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff4d4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1874687714980352:0@lo:400:kworker.0 00000100:00100000:1.0:1787841790.209751:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841790.209829:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff4d5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687714980480:0@lo:400:kworker.0 00000100:00100000:0.0:1787841790.209864:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841790.209891:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787841790.209897:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff4d52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3298:1874687714980096:0@lo:400:kworker.0 00000100:00100000:0.0:1787841790.209936:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841790.209958:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff4d5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1874687714980608:0@lo:400:kworker.0 00000100:00100000:0.0:1787841790.209979:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841790.210111:0:9572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714980480 00000100:00100000:1.0:1787841790.210119:0:9572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714980480 00000100:00100000:1.0:1787841790.210269:0:9572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787841790.210281:0:9572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd7a0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3298:x1874687714980480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841790.210350:0:9572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd7a0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3298:x1874687714980480:12345-0@lo:400:kworker.0 Request processed in 72us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841790.210363:0:9572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787841790.210460:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff4d5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687714980480:0@lo:400:kworker.0 00000100:00080000:0.0:1787841790.210516:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787841790.210517:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714979968 00000100:00100000:2.0:1787841790.210524:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714979968 00000100:00100000:0.0:1787841790.210560:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714980224 00000100:00100000:0.0:1787841790.210565:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714980224 00000100:00100000:2.0:1787841790.210583:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787841790.210594:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff4d6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874687714979968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787841790.210626:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787841790.210672:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff4d6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874687714979968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (1565us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841790.210679:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787841790.210688:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714980352 00000100:00100000:0.0:1787841790.210693:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714980352 00000100:00100000:2.0:1787841790.210726:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714980096 00000100:00100000:2.0:1787841790.210732:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714980096 00000100:00100000:2.0:1787841790.210759:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1787841790.210766:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:3298:x1874687714980096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841790.210798:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:3298:x1874687714980096:12345-0@lo:400:kworker.0 Request processed in 32us (861us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841790.210806:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1787841790.210820:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714980608 00000100:00100000:1.0:1787841790.210825:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714980608 00000100:00100000:2.0:1787841790.210841:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1787841790.210860:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff4d61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874687714980224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841790.210909:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff4d61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874687714980224:12345-0@lo:400:kworker.0 Request processed in 51us (1238us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841790.210952:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1787841790.210961:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff4d4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874687714980352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841790.210997:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff4d4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874687714980352:12345-0@lo:400:kworker.0 Request processed in 38us (1244us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841790.211003:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1787841790.211017:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787841790.211023:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd7a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1874687714980608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841790.211050:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd7a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1874687714980608:12345-0@lo:400:kworker.0 Request processed in 28us (1070us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841790.211055:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787841790.211084:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff4d4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1874687714980352:0@lo:400:kworker.0 00000100:00100000:1.0:1787841790.211095:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff4d7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874687714980224:0@lo:400:kworker.0 00000100:00080000:1.0:1787841790.211121:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787841790.211124:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787841790.211141:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff4d52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3298:1874687714980096:0@lo:400:kworker.0 00000100:00100000:1.0:1787841790.211151:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff4d5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1874687714980608:0@lo:400:kworker.0 00010000:00080000:1.0:1787841790.211175:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbf8dc9680 x1874687714979968/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841806 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787841790.211192:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf8dc9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687714979968:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787841790.222924:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00010000:00010000:2.0:1787841790.530505:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787841791.233328:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787841791.233351:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff4d5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874687714980736:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787841791.233430:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841791.233635:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714980736 00000100:00100000:1.0:1787841791.233666:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714980736 00000100:00100000:1.0:1787841791.233740:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787841791.233750:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbd4bb1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874687714980736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787841791.233786:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787841791.233840:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbd4bb1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874687714980736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841791.233848:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787841791.233967:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff4d5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874687714980736:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787841791.553018:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787841792.156823:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841792.156862:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841792.156888:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841792.156958:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841792.156988:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695020928 00000100:00100000:1.0:1787841792.156997:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695020928 00000100:00100000:1.0:1787841792.157051:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 56 00000100:00100000:1.0:1787841792.157059:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff4d4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b2767a54-6703-4908-8414-eab6601e2ceb+5:2356:x1874687695020928:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:1.0:1787841792.157121:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff4d4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b2767a54-6703-4908-8414-eab6601e2ceb+5:2356:x1874687695020928:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 63us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841792.157138:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 56 00000100:00080000:1.0:1787841792.157169:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787841792.157336:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695020672 00000100:00100000:0.0:1787841792.157340:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695020672 00000100:00100000:0.0:1787841792.157366:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 288 00000100:00100000:0.0:1787841792.157372:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a1f1ce-26b5-4cc6-a1db-8e09063432da+13:2356:x1874687695020672:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:0.0:1787841792.157401:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a1f1ce-26b5-4cc6-a1db-8e09063432da+13:2356:x1874687695020672:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 30us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841792.157407:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 288 00000100:00100000:3.0:1787841792.158570:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695020800 00000100:00100000:3.0:1787841792.158578:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695020800 00000100:00080000:1.0:1787841792.158681:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787841792.158724:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695021056 00000100:00100000:3.0:1787841792.158728:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695021056 00000100:00100000:3.0:1787841792.158768:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 129 00000100:00100000:3.0:1787841792.158776:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff4d52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+5:2357:x1874687695020800:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:3.0:1787841792.158824:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff4d52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+5:2357:x1874687695020800:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 50us (1961us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841792.158830:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 129 00000100:00100000:3.0:1787841792.158842:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 130 00000100:00100000:3.0:1787841792.158848:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff4d7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fe7d2185-ae43-428e-8bfa-909f60138853+5:2357:x1874687695021056:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:3.0:1787841792.158865:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff4d7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fe7d2185-ae43-428e-8bfa-909f60138853+5:2357:x1874687695021056:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 18us (1977us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841792.158871:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 130 00000100:00080000:1.0:1787841792.159173:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787841792.581384:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841793.600957:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841794.626848:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787841795.330088:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf04c1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874687714981248:0@lo:400:kworker.0 00000100:00100000:3.0:1787841795.330166:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841795.332038:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787841795.332056:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4bb0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3300:1874687714980864:0@lo:400:kworker.0 00000100:00100000:3.0:1787841795.332124:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841795.332157:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf04c2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1874687714981376:0@lo:400:kworker.0 00000100:00100000:3.0:1787841795.332183:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841795.332340:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf04c1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1874687714981120:0@lo:400:kworker.0 00000100:00100000:3.0:1787841795.332369:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841795.332390:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787841795.332397:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4bb21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874687714980992:0@lo:400:kworker.0 00000100:00100000:3.0:1787841795.332421:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841795.332436:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf04c2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874687714981504:0@lo:400:kworker.0 00000100:00100000:3.0:1787841795.332458:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841795.332488:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714981376 00000100:00100000:3.0:1787841795.332496:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714981376 00000100:00100000:3.0:1787841795.332546:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714981120 00000100:00100000:3.0:1787841795.332549:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714981120 00000100:00100000:3.0:1787841795.332563:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714980992 00000100:00100000:3.0:1787841795.332565:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714980992 00000100:00100000:3.0:1787841795.332580:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787841795.332589:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf04c21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874687714981376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787841795.332645:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf04c21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874687714981376:12345-0@lo:400:kworker.0 Request processed in 57us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841795.332652:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787841795.332669:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787841795.332676:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf04c0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874687714981120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787841795.332725:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf04c0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874687714981120:12345-0@lo:400:kworker.0 Request processed in 49us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841795.332747:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787841795.332761:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1787841795.332766:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff40a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874687714980992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787841795.332795:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff40a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874687714980992:12345-0@lo:400:kworker.0 Request processed in 29us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841795.332801:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1787841795.332822:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714981248 00000100:00100000:3.0:1787841795.332826:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714981248 00000100:00080000:2.0:1787841795.333038:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787841795.333052:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787841795.333103:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf04c2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1874687714981376:0@lo:400:kworker.0 00000100:00100000:2.0:1787841795.333137:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf8dc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874687714981632:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787841795.333168:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841795.333195:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4bb21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874687714980992:0@lo:400:kworker.0 00000100:00100000:2.0:1787841795.333206:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf04c1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1874687714981120:0@lo:400:kworker.0 00000100:00100000:2.0:1787841795.333245:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714981632 00000100:00100000:2.0:1787841795.333249:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714981632 00000100:00100000:2.0:1787841795.333283:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787841795.333290:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf8dc9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874687714981632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787841795.333321:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787841795.333357:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf8dc9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874687714981632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841795.333363:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:2.0:1787841795.333383:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787841795.333402:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbf8dc8000 x1874687714981632/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841811 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787841795.333417:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf8dc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874687714981632:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787841795.333441:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714981504 00000100:00100000:2.0:1787841795.333444:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714981504 00000100:00100000:2.0:1787841795.333466:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787841795.333473:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf04c0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1874687714981248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841795.333507:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf04c0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1874687714981248:12345-0@lo:400:kworker.0 Request processed in 35us (3342us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841795.333513:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787841795.333532:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787841795.333537:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff409a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1874687714981504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841795.333568:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff409a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1874687714981504:12345-0@lo:400:kworker.0 Request processed in 31us (1109us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841795.333573:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:2.0:1787841795.333597:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbf04c2580 x1874687714981504/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787841811 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787841795.333607:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf04c2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874687714981504:0@lo:400:kworker.0 00000100:00100000:2.0:1787841795.333628:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf04c1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874687714981248:0@lo:400:kworker.0 00000100:00100000:1.0:1787841795.334142:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714980864 00000100:00100000:1.0:1787841795.334148:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714980864 00000100:00100000:1.0:1787841795.334182:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1787841795.334189:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:3300:x1874687714980864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841795.334252:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:3300:x1874687714980864:12345-0@lo:400:kworker.0 Request processed in 63us (2127us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841795.334270:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1787841795.334369:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4bb0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3300:1874687714980864:0@lo:400:kworker.0 00010000:00010000:0.0:1787841795.650408:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787841796.355254:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff4d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874687714981760:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787841796.355350:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841796.355897:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714981760 00000100:00100000:1.0:1787841796.355905:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714981760 00000100:00100000:1.0:1787841796.355967:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787841796.355978:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf8dc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874687714981760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787841796.356014:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787841796.356090:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf8dc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874687714981760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (741us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841796.356099:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787841796.356153:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff4d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874687714981760:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787841796.673627:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787841797.121738:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787841797.262577:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841797.262632:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841797.262807:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695021312 00000100:00100000:3.0:1787841797.262816:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695021312 00000100:00100000:3.0:1787841797.262897:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 134 00000100:00100000:3.0:1787841797.262908:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff4d7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+5:2357:x1874687695021312:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:3.0:1787841797.262984:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff4d7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+5:2357:x1874687695021312:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 78us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841797.262992:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 134 00000100:00080000:0.0:1787841797.263074:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787841797.263846:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695021184 00000100:00100000:2.0:1787841797.263854:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695021184 00000100:00100000:2.0:1787841797.263949:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 290 00000100:00100000:2.0:1787841797.263958:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a1f1ce-26b5-4cc6-a1db-8e09063432da+13:2356:x1874687695021184:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:2.0:1787841797.264012:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a1f1ce-26b5-4cc6-a1db-8e09063432da+13:2356:x1874687695021184:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 56us (1379us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841797.264019:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 290 00000100:00100000:1.0:1787841797.266459:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841797.266596:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695021568 00000100:00100000:3.0:1787841797.266609:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695021568 00000100:00100000:3.0:1787841797.266685:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 135 00000100:00100000:3.0:1787841797.266695:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff4d5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fe7d2185-ae43-428e-8bfa-909f60138853+5:2357:x1874687695021568:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:3.0:1787841797.266787:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff4d5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fe7d2185-ae43-428e-8bfa-909f60138853+5:2357:x1874687695021568:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 94us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841797.266793:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 135 00000100:00080000:0.0:1787841797.266867:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787841797.278972:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841797.279291:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695021440 00000100:00100000:2.0:1787841797.279303:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695021440 00000100:00100000:2.0:1787841797.279395:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 59 00000100:00100000:2.0:1787841797.279407:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff409680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b2767a54-6703-4908-8414-eab6601e2ceb+5:2356:x1874687695021440:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:2.0:1787841797.279515:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff409680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b2767a54-6703-4908-8414-eab6601e2ceb+5:2356:x1874687695021440:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 111us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841797.279522:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 59 00000100:00080000:0.0:1787841797.280069:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787841797.697000:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841798.721142:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841799.745188:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787841800.449093:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4bb0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874687714981888:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787841800.449171:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841800.449511:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714981888 00000100:00100000:2.0:1787841800.449519:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714981888 00000100:00100000:2.0:1787841800.449591:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787841800.449602:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd7a3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874687714981888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787841800.449637:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787841800.449691:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd7a3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874687714981888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841800.449718:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:0.0:1787841800.449846:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787841800.451980:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbd4bb0b40 x1874687714981888/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841816 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787841800.452035:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4bb0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874687714981888:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787841800.452245:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4bb0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874687714982144:0@lo:400:kworker.0 00000100:00100000:0.0:1787841800.452309:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841800.452359:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787841800.452366:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4bb21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3299:1874687714982016:0@lo:400:kworker.0 00000100:00100000:0.0:1787841800.452395:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841800.452439:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714982016 00000100:00100000:0.0:1787841800.452447:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714982016 00000100:00100000:0.0:1787841800.452486:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1787841800.452495:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:3299:x1874687714982016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841800.452543:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:3299:x1874687714982016:12345-0@lo:400:kworker.0 Request processed in 49us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841800.452551:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1787841800.452590:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4bb21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3299:1874687714982016:0@lo:400:kworker.0 00000100:00100000:3.0:1787841800.452669:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714982144 00000100:00100000:3.0:1787841800.452673:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714982144 00000100:00100000:3.0:1787841800.452727:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1787841800.452734:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd7a1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874687714982144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787841800.452775:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd7a1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874687714982144:12345-0@lo:400:kworker.0 Request processed in 41us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841800.452781:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1787841800.453005:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf04c1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1874687714982272:0@lo:400:kworker.0 00000100:00100000:3.0:1787841800.453035:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841800.453055:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787841800.453061:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf04c2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874687714982400:0@lo:400:kworker.0 00000100:00100000:3.0:1787841800.453097:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841800.453126:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714982272 00000100:00100000:3.0:1787841800.453130:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714982272 00000100:00100000:3.0:1787841800.453164:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1787841800.453170:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff40b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874687714982272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787841800.453203:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff40b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874687714982272:12345-0@lo:400:kworker.0 Request processed in 34us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841800.453209:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00080000:3.0:1787841800.453225:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787841800.453244:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf04c1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1874687714982272:0@lo:400:kworker.0 00000100:00100000:2.0:1787841800.453423:0:9572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714982400 00000100:00100000:2.0:1787841800.453428:0:9572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714982400 00000100:00100000:2.0:1787841800.453469:0:9572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787841800.453476:0:9572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff408000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1874687714982400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841800.453513:0:9572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff408000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1874687714982400:12345-0@lo:400:kworker.0 Request processed in 38us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841800.453519:0:9572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787841800.453662:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4bb0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874687714982144:0@lo:400:kworker.0 00000100:00100000:0.0:1787841800.453675:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787841800.453681:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf04c1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1874687714982528:0@lo:400:kworker.0 00000100:00100000:0.0:1787841800.453728:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841800.455967:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714982528 00000100:00100000:2.0:1787841800.456283:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714982528 00000100:00100000:2.0:1787841800.456372:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787841800.456383:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd7a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1874687714982528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841800.456482:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd7a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1874687714982528:12345-0@lo:400:kworker.0 Request processed in 101us (2752us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841800.456489:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00080000:3.0:1787841800.457242:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787841800.457249:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787841800.457292:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf04c2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874687714982400:0@lo:400:kworker.0 00000100:00100000:0.0:1787841800.458209:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf04c1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1874687714982528:0@lo:400:kworker.0 00010000:00010000:2.0:1787841800.768888:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787841801.478146:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff4d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874687714982656:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787841801.478233:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841801.478667:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714982656 00000100:00100000:1.0:1787841801.478675:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714982656 00000100:00100000:1.0:1787841801.478773:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787841801.478783:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd7a30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874687714982656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787841801.478821:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787841801.478873:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd7a30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874687714982656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841801.478880:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787841801.480544:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff4d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874687714982656:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787841801.793031:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787841802.384027:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841802.384090:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841802.384213:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695021824 00000100:00100000:0.0:1787841802.384228:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695021824 00000100:00100000:2.0:1787841802.384305:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695021696 00000100:00100000:2.0:1787841802.384316:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695021696 00000100:00100000:0.0:1787841802.384329:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 139 00000100:00100000:0.0:1787841802.384348:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff4d70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+5:2356:x1874687695021824:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:2.0:1787841802.384399:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 292 00000100:00100000:2.0:1787841802.384418:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a1f1ce-26b5-4cc6-a1db-8e09063432da+13:2356:x1874687695021696:12345-192.168.201.1@tcp:400:kworker.0 00000100:00080000:3.0:1787841802.384491:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787841802.386751:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff4d70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+5:2356:x1874687695021824:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 2399us (2648us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841802.386783:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 139 00000100:00100000:2.0:1787841802.392598:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a1f1ce-26b5-4cc6-a1db-8e09063432da+13:2356:x1874687695021696:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 8158us (8560us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841802.392618:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 292 00000100:00100000:1.0:1787841802.409337:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841802.409548:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841802.409692:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695022080 00000100:00100000:0.0:1787841802.409737:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695022080 00000100:00080000:3.0:1787841802.410227:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787841802.410287:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 140 00000100:00100000:0.0:1787841802.410301:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff4d4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fe7d2185-ae43-428e-8bfa-909f60138853+5:2356:x1874687695022080:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:0.0:1787841802.410417:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff4d4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fe7d2185-ae43-428e-8bfa-909f60138853+5:2356:x1874687695022080:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 119us (868us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841802.410426:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 140 00000100:00100000:2.0:1787841802.410500:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695021952 00000100:00100000:2.0:1787841802.410506:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695021952 00000100:00080000:3.0:1787841802.410539:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787841802.410556:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 20 00000100:00100000:2.0:1787841802.410564:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff4d6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b2767a54-6703-4908-8414-eab6601e2ceb+5:2353:x1874687695021952:12345-192.168.201.1@tcp:9:kworker.0 00000020:00000080:2.0:1787841802.410594:0:6687:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe3dac0c99affe451 00000100:00080000:2.0:1787841802.410606:0:6687:0:(import.c:65:import_set_state_nolock()) ffff92cac3158000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787841802.410664:0:6687:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:2.0:1787841802.411090:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff4d6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b2767a54-6703-4908-8414-eab6601e2ceb+2:2353:x1874687695021952:12345-192.168.201.1@tcp:9:kworker.0 Request processed in 526us (1769us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841802.411103:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 20 00010000:00010000:3.0:1787841802.412274:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841802.817143:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841803.842985:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787841804.628274:0:6717:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b2767a54-6703-4908-8414-eab6601e2ceb 00000020:00000080:2.0:1787841804.628284:0:6717:0:(genops.c:885:class_export_put()) final put ffff92cac315c000/b2767a54-6703-4908-8414-eab6601e2ceb 00000020:00000080:3.0:1787841804.628427:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff92cac315c000/b2767a54-6703-4908-8414-eab6601e2ceb for lustre-OST0000 00000020:00000080:3.0:1787841804.631297:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92cac3158000 for lustre-OST0000 00010000:00010000:0.0:1787841804.865726:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787841805.570327:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff40b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3300:1874687714982784:0@lo:400:kworker.0 00000100:00100000:0.0:1787841805.570363:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4bac780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874687714983168:0@lo:400:kworker.0 00000100:00100000:2.0:1787841805.570459:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4bac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1874687714983040:0@lo:400:kworker.0 00000100:00100000:1.0:1787841805.571809:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4bacb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874687714982912:0@lo:400:kworker.0 00000100:00100000:3.0:1787841805.571882:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841805.577341:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841805.577475:0:9572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714983168 00000100:00100000:0.0:1787841805.577485:0:9572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714983168 00000100:00100000:0.0:1787841805.577543:0:9572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787841805.577553:0:9572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd7a2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1874687714983168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841805.577633:0:9572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd7a2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1874687714983168:12345-0@lo:400:kworker.0 Request processed in 81us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841805.577641:0:9572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:0.0:1787841805.577663:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787841805.577714:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4bac780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874687714983168:0@lo:400:kworker.0 00000100:00100000:0.0:1787841805.577751:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714982784 00000100:00100000:0.0:1787841805.577755:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714982784 00000100:00100000:0.0:1787841805.577799:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1787841805.577807:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:3300:x1874687714982784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841805.578385:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:3300:x1874687714982784:12345-0@lo:400:kworker.0 Request processed in 577us (7978us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841805.578394:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1787841805.582870:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841805.583277:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf04c2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687714983552:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787841805.583317:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841805.583478:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714983040 00000100:00100000:0.0:1787841805.583488:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714983040 00000100:00100000:0.0:1787841805.583560:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787841805.583571:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf04c1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1874687714983040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841805.583631:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf04c1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1874687714983040:12345-0@lo:400:kworker.0 Request processed in 62us (771us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841805.583637:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787841805.583676:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714983552 00000100:00100000:0.0:1787841805.583680:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714983552 00000100:00100000:0.0:1787841805.583731:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787841805.583738:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf04c2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874687714983552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787841805.583766:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787841805.583798:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf04c2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874687714983552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841805.583805:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:2.0:1787841805.583932:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787841805.583938:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787841805.584001:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4bac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1874687714983040:0@lo:400:kworker.0 00010000:00080000:2.0:1787841805.584018:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbf04c2940 x1874687714983552/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841821 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787841805.584034:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf04c2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687714983552:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787841805.585419:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841805.585467:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4bada40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874687714983424:0@lo:400:kworker.0 00000100:00100000:1.0:1787841805.585498:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841805.585612:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714982912 00000100:00100000:2.0:1787841805.585619:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714982912 00000100:00100000:2.0:1787841805.585661:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1787841805.585669:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff4d6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874687714982912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841805.585733:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff4d6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874687714982912:12345-0@lo:400:kworker.0 Request processed in 65us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841805.585741:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787841805.585952:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4bacb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874687714982912:0@lo:400:kworker.0 00000100:00100000:0.0:1787841805.587201:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714983424 00000100:00100000:0.0:1787841805.587210:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714983424 00000100:00100000:0.0:1787841805.587387:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787841805.587398:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff4d43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1874687714983424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841805.587485:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff4d43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1874687714983424:12345-0@lo:400:kworker.0 Request processed in 90us (1986us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841805.587492:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:1.0:1787841805.587571:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbd4bada40 x1874687714983424/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787841821 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787841805.587585:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4bada40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874687714983424:0@lo:400:kworker.0 00000100:00100000:3.0:1787841805.588847:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff40b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3300:1874687714982784:0@lo:400:kworker.0 00000100:00100000:3.0:1787841805.588862:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4bae940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1874687714983296:0@lo:400:kworker.0 00000100:00100000:3.0:1787841805.589007:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841805.589229:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714983296 00000100:00100000:0.0:1787841805.589259:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714983296 00000100:00080000:2.0:1787841805.589382:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787841805.589421:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1787841805.589430:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbd4bada40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874687714983296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841805.589491:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbd4bada40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874687714983296:12345-0@lo:400:kworker.0 Request processed in 63us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841805.589499:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787841805.589525:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4bae940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1874687714983296:0@lo:400:kworker.0 00010000:00010000:3.0:1787841805.889022:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787841806.595647:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787841806.595680:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff4d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687714983680:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787841806.595790:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841806.595900:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714983680 00000100:00100000:1.0:1787841806.595909:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714983680 00000100:00100000:1.0:1787841806.595989:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787841806.596002:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff4d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874687714983680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787841806.596050:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787841806.596251:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff4d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874687714983680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 250us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841806.596260:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787841806.596905:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff4d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687714983680:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787841806.913142:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787841807.361364:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787841807.505037:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841807.505108:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841807.505744:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841807.505842:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695022336 00000100:00100000:2.0:1787841807.505854:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695022336 00000100:00100000:2.0:1787841807.505937:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695022464 00000100:00100000:2.0:1787841807.505941:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695022464 00000100:00100000:2.0:1787841807.505968:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 144 00000100:00100000:2.0:1787841807.505977:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff4d5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+5:2354:x1874687695022336:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:2.0:1787841807.506051:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff4d5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+5:2354:x1874687695022336:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 75us (1026us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841807.506058:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 144 00000100:00100000:2.0:1787841807.506076:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 145 00000100:00100000:2.0:1787841807.506082:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff4d5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fe7d2185-ae43-428e-8bfa-909f60138853+5:2354:x1874687695022464:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:2.0:1787841807.506108:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff4d5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fe7d2185-ae43-428e-8bfa-909f60138853+5:2354:x1874687695022464:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 27us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841807.506129:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 145 00000100:00100000:2.0:1787841807.506151:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695022208 00000100:00100000:2.0:1787841807.506154:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695022208 00000100:00080000:3.0:1787841807.506566:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787841807.507020:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 294 00000100:00100000:0.0:1787841807.507032:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a1f1ce-26b5-4cc6-a1db-8e09063432da+13:2354:x1874687695022208:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:0.0:1787841807.507077:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a1f1ce-26b5-4cc6-a1db-8e09063432da+13:2354:x1874687695022208:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 50us (1970us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841807.507083:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 294 00010000:00010000:2.0:1787841807.936935:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841808.965633:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787841809.972764:0:11849:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 10:43:28 (1787841808) 00010000:00010000:2.0:1787841809.993209:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787841810.689140:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf04c1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3300:1874687714983808:0@lo:400:kworker.0 00000100:00100000:1.0:1787841810.689546:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4bac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874687714983936:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787841810.689625:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841810.690151:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714983936 00000100:00100000:3.0:1787841810.690173:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714983936 00000100:00100000:3.0:1787841810.690248:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787841810.690258:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff4d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874687714983936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787841810.690303:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787841810.692997:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841810.693092:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714983808 00000100:00100000:0.0:1787841810.693103:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714983808 00000100:00100000:0.0:1787841810.693148:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1787841810.693158:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:3300:x1874687714983808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841810.693213:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:3300:x1874687714983808:12345-0@lo:400:kworker.0 Request processed in 57us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841810.693220:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1787841810.693278:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf04c1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3300:1874687714983808:0@lo:400:kworker.0 00000100:00080000:0.0:1787841810.693345:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787841810.694497:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf04c1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1874687714984192:0@lo:400:kworker.0 00000100:00100000:2.0:1787841810.694557:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841810.694591:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787841810.694597:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf04c2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874687714984064:0@lo:400:kworker.0 00000100:00100000:0.0:1787841810.696392:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e67c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874687714984320:0@lo:400:kworker.0 00000100:00100000:0.0:1787841810.696473:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841810.696522:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787841810.696530:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e66940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1874687714984448:0@lo:400:kworker.0 00000100:00100000:0.0:1787841810.696556:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841810.696589:0:9572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714984320 00000100:00100000:0.0:1787841810.696597:0:9572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714984320 00000100:00100000:0.0:1787841810.696671:0:9572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787841810.696682:0:9572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd7a0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1874687714984320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841810.696766:0:9572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd7a0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1874687714984320:12345-0@lo:400:kworker.0 Request processed in 86us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841810.696774:0:9572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787841810.696799:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714984192 00000100:00100000:0.0:1787841810.696803:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714984192 00000100:00100000:0.0:1787841810.696849:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714984448 00000100:00100000:0.0:1787841810.696854:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714984448 00000100:00100000:0.0:1787841810.696876:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787841810.696883:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e64780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874687714984192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841810.696929:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e64780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874687714984192:12345-0@lo:400:kworker.0 Request processed in 47us (2372us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841810.696935:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787841810.696947:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1787841810.696953:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd7a3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874687714984448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841810.696981:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd7a3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874687714984448:12345-0@lo:400:kworker.0 Request processed in 28us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841810.697002:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00080000:0.0:1787841810.697024:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787841810.697029:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787841810.697057:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e66940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1874687714984448:0@lo:400:kworker.0 00000100:00100000:0.0:1787841810.697068:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e67c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874687714984320:0@lo:400:kworker.0 00000100:00100000:3.0:1787841810.697902:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff4d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874687714983936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 7640us (8270us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841810.697923:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787841810.698383:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841810.698421:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf04c1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1874687714984192:0@lo:400:kworker.0 00000100:00100000:0.0:1787841810.703613:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714984064 00000100:00100000:0.0:1787841810.703629:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714984064 00000100:00100000:0.0:1787841810.703745:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1787841810.703757:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e64f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874687714984064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841810.703895:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e64f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874687714984064:12345-0@lo:400:kworker.0 Request processed in 140us (5512us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841810.703903:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787841810.704095:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf04c2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874687714984064:0@lo:400:kworker.0 00010000:00080000:1.0:1787841810.708332:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbd4bac000 x1874687714983936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841826 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787841810.708361:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4bac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874687714983936:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787841811.009880:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787841811.653274:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841811.653389:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695022592 00000100:00100000:0.0:1787841811.653398:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695022592 00000100:00100000:0.0:1787841811.653462:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 32 00000100:00100000:0.0:1787841811.653472:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf90c0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+5:10243:x1874687695022592:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787841811.653493:0:9449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841811.653516:0:9449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725c00/0xe3dac0c99affe51c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d67d4 expref: -99 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841811.653572:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6724a00/0xe3dac0c99affe523 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841811.653600:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6724a00/0xe3dac0c99affe523 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841811.653614:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6724a00/0xe3dac0c99affe523 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787841811.653833:0:9449:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787841811.653837:0:9449:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787841811.653925:0:9449:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6724a00/0xe3dac0c99affe523 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841811.653949:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725c00/0xe3dac0c99affe51c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d67d4 expref: 7 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841811.653964:0:9449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6724a00/0xe3dac0c99affe523 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d67d4 expref: 6 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841811.653973:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92cbc57e3900) 00010000:00010000:0.0:1787841811.653976:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787841811.653980:0:9449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc6724a00, rc 0) 00000100:00100000:0.0:1787841811.654031:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf90c0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+6:10243:x1874687695022592:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 Request processed in 562us (767us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841811.654037:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 32 00000100:00080000:1.0:1787841811.654339:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787841811.658979:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841811.659115:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695022720 00000100:00100000:0.0:1787841811.659128:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695022720 00000100:00100000:0.0:1787841811.659207:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 33 00000100:00100000:0.0:1787841811.659222:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e66d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+6:10244:x1874687695022720:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787841811.659265:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841811.659299:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6724400/0xe3dac0c99affe52a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d67db expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841811.659384:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725800/0xe3dac0c99affe531 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841811.659421:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725800/0xe3dac0c99affe531 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841811.659435:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725800/0xe3dac0c99affe531 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841811.659453:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6724800/0xe3dac0c99affe538 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841811.659460:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6724800/0xe3dac0c99affe538 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841811.659466:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6724800/0xe3dac0c99affe538 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841811.659956:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725a00/0xe3dac0c99affe53f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841811.659967:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725a00/0xe3dac0c99affe53f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841811.659974:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725a00/0xe3dac0c99affe53f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787841811.660051:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1787841811.660056:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787841811.660135:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725a00/0xe3dac0c99affe53f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841811.660148:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725800/0xe3dac0c99affe531 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841811.660164:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725800/0xe3dac0c99affe531 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841811.660170:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725800/0xe3dac0c99affe531 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841811.660177:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6725800 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:0.0:1787841811.660182:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725800/0xe3dac0c99affe531 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841811.660189:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725800/0xe3dac0c99affe531 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841811.660201:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92cbc57e3900) 00010000:00010000:0.0:1787841811.660204:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841811.660209:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725800/0xe3dac0c99affe531 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841811.660216:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725800/0xe3dac0c99affe531 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841811.660230:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6724800/0xe3dac0c99affe538 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841811.660235:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6724800/0xe3dac0c99affe538 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841811.660241:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6724800/0xe3dac0c99affe538 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841811.660246:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6724800 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:0.0:1787841811.660255:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6724800/0xe3dac0c99affe538 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841811.660261:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6724800/0xe3dac0c99affe538 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841811.660268:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff92cbc57e3e00) 00010000:00010000:0.0:1787841811.660270:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841811.660273:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6724800/0xe3dac0c99affe538 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841811.660279:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6724800/0xe3dac0c99affe538 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841811.660312:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6724400/0xe3dac0c99affe52a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d67db expref: 8 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841811.660324:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725a00/0xe3dac0c99affe53f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d67db expref: 7 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841811.660331:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff92cbc57e3500) 00010000:00010000:0.0:1787841811.660333:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787841811.660335:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc6725a00, rc 0) 00000100:00100000:0.0:1787841811.660415:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e66d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+7:10244:x1874687695022720:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 Request processed in 1197us (1450us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841811.660424:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 33 00000100:00100000:3.0:1787841811.663625:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841811.664202:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695022976 00000100:00100000:0.0:1787841811.664214:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695022976 00000100:00100000:0.0:1787841811.664285:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 34 00000100:00100000:0.0:1787841811.664295:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbd4bac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+7:10244:x1874687695022976:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787841811.664321:0:9449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841811.664343:0:9449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6724c00/0xe3dac0c99affe546 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d67e2 expref: -99 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841811.664424:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725400/0xe3dac0c99affe54d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841811.664439:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725400/0xe3dac0c99affe54d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841811.664450:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725400/0xe3dac0c99affe54d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841811.664530:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3ae00/0xe3dac0c99affe554 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841811.664538:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3ae00/0xe3dac0c99affe554 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841811.664545:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3ae00/0xe3dac0c99affe554 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841811.665141:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3ac00/0xe3dac0c99affe55b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841811.665153:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3ac00/0xe3dac0c99affe55b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841811.665160:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3ac00/0xe3dac0c99affe55b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787841811.665171:0:9449:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1787841811.665367:0:9449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725400/0xe3dac0c99affe54d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841811.665375:0:9449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725400/0xe3dac0c99affe54d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841811.665382:0:9449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725400/0xe3dac0c99affe54d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841811.665388:0:9449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6725400 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:0.0:1787841811.665393:0:9449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725400/0xe3dac0c99affe54d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841811.665400:0:9449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725400/0xe3dac0c99affe54d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841811.665412:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff92cbc57e3500) 00010000:00010000:0.0:1787841811.665415:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841811.665420:0:9449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725400/0xe3dac0c99affe54d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841811.665426:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725400/0xe3dac0c99affe54d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841811.665440:0:9449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3ae00/0xe3dac0c99affe554 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841811.665446:0:9449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3ae00/0xe3dac0c99affe554 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841811.665453:0:9449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3ae00/0xe3dac0c99affe554 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841811.665466:0:9449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbffa3ae00 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:0.0:1787841811.665470:0:9449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3ae00/0xe3dac0c99affe554 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841811.665475:0:9449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3ae00/0xe3dac0c99affe554 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841811.665482:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff92cbc57e3f00) 00010000:00010000:0.0:1787841811.665484:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841811.665486:0:9449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3ae00/0xe3dac0c99affe554 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841811.665492:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3ae00/0xe3dac0c99affe554 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841811.665924:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6724c00/0xe3dac0c99affe546 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d67e2 expref: 10 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841811.665942:0:9449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3ac00/0xe3dac0c99affe55b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d67e2 expref: 9 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841811.665948:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff92cbc57e3b00) 00010000:00010000:0.0:1787841811.665950:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841811.665952:0:9449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbffa3ac00, rc 0) 00000100:00100000:0.0:1787841811.669605:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbd4bac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+9:10244:x1874687695022976:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 Request processed in 5282us (5961us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1787841811.669623:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 34 00000100:00100000:1.0:1787841811.673547:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841811.673888:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695023104 00000100:00100000:0.0:1787841811.673914:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695023104 00000100:00100000:0.0:1787841811.673977:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 35 00000100:00100000:0.0:1787841811.673988:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf90c2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+9:10244:x1874687695023104:12345-192.168.201.1@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1787841811.674108:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf90c2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+9:10244:x1874687695023104:12345-192.168.201.1@tcp:59:lhsmtool_posix.0 Request processed in 122us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841811.674117:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 35 00000100:00100000:0.0:1787841811.720359:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf90c03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687714984576:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787841811.720443:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841811.720536:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714984576 00000100:00100000:0.0:1787841811.720546:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714984576 00000100:00100000:0.0:1787841811.720610:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787841811.720620:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe794bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874687714984576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787841811.720660:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787841811.720754:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe794bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874687714984576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 134us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841811.720763:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787841811.720844:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf90c03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687714984576:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787841812.033367:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787841812.485153:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787841812.622403:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841812.622440:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841812.622471:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841812.622510:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695023488 00000100:00100000:2.0:1787841812.622523:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695023488 00000100:00100000:2.0:1787841812.622602:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695023360 00000100:00100000:2.0:1787841812.622605:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695023360 00000100:00100000:2.0:1787841812.622630:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 149 00000100:00100000:2.0:1787841812.622641:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e66940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fe7d2185-ae43-428e-8bfa-909f60138853+5:2354:x1874687695023488:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:2.0:1787841812.622776:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e66940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fe7d2185-ae43-428e-8bfa-909f60138853+5:2354:x1874687695023488:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 136us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841812.622784:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 149 00000100:00100000:2.0:1787841812.622826:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 150 00000100:00100000:2.0:1787841812.622832:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+9:2354:x1874687695023360:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:2.0:1787841812.622861:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+9:2354:x1874687695023360:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 29us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841812.622868:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 150 00000100:00080000:2.0:1787841812.622889:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787841812.623804:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695023232 00000100:00100000:1.0:1787841812.623814:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695023232 00000100:00100000:1.0:1787841812.623904:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 296 00000100:00100000:1.0:1787841812.623914:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a1f1ce-26b5-4cc6-a1db-8e09063432da+13:2354:x1874687695023232:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:1.0:1787841812.623977:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a1f1ce-26b5-4cc6-a1db-8e09063432da+13:2354:x1874687695023232:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 65us (1592us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841812.623986:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 296 00010000:00010000:2.0:1787841813.062817:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787841813.742431:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841813.742486:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695023616 00000100:00100000:1.0:1787841813.742499:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695023616 00000100:00100000:1.0:1787841813.742597:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 36 00000100:00100000:1.0:1787841813.742609:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf90c3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+9:10287:x1874687695023616:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:1.0:1787841813.742647:0:9449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841813.742683:0:9449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9ca00/0xe3dac0c99affe569 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d67e9 expref: -99 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841813.742810:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d800/0xe3dac0c99affe570 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841813.742828:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d800/0xe3dac0c99affe570 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841813.742976:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d800/0xe3dac0c99affe570 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841813.742998:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9da00/0xe3dac0c99affe577 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841813.743006:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9da00/0xe3dac0c99affe577 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841813.743013:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9da00/0xe3dac0c99affe577 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841813.743333:0:9449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d800/0xe3dac0c99affe570 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841813.743343:0:9449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d800/0xe3dac0c99affe570 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841813.743351:0:9449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d800/0xe3dac0c99affe570 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841813.743358:0:9449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cc00d9d800 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:1.0:1787841813.743363:0:9449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d800/0xe3dac0c99affe570 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841813.743371:0:9449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d800/0xe3dac0c99affe570 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841813.743387:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92cbc57e3900) 00010000:00010000:1.0:1787841813.743390:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787841813.743396:0:9449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d800/0xe3dac0c99affe570 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841813.743409:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d800/0xe3dac0c99affe570 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841813.743424:0:9449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9da00/0xe3dac0c99affe577 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841813.743431:0:9449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9da00/0xe3dac0c99affe577 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841813.743437:0:9449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9da00/0xe3dac0c99affe577 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841813.743443:0:9449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cc00d9da00 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:1.0:1787841813.743445:0:9449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9da00/0xe3dac0c99affe577 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841813.743451:0:9449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9da00/0xe3dac0c99affe577 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841813.743459:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff92cbd1fc7900) 00010000:00010000:1.0:1787841813.743462:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787841813.743464:0:9449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9da00/0xe3dac0c99affe577 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841813.743470:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9da00/0xe3dac0c99affe577 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841813.743510:0:9449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9ca00/0xe3dac0c99affe569 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d67e9 expref: 10 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841813.743535:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92cbc57e3900) 00010000:00010000:1.0:1787841813.743538:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787841813.743543:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9ca00/0xe3dac0c99affe569 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d67e9 expref: 10 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841813.743553:0:9449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cc00d9ca00, rc 0) 00000100:00100000:1.0:1787841813.743637:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf90c3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+9:10287:x1874687695023616:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 1030us (1221us total) trans 0 rc 301/301 00000100:00100000:1.0:1787841813.743647:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 36 00000100:00080000:1.0:1787841813.745043:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787841813.753426:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841813.753501:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695023872 00000100:00100000:0.0:1787841813.753514:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695023872 00000100:00100000:0.0:1787841813.753591:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 37 00000100:00100000:0.0:1787841813.753602:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf90c0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+9:10287:x1874687695023872:12345-192.168.201.1@tcp:36:lfs.0 00010000:00010000:0.0:1787841813.754042:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787841813.754093:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6724a00/0xe3dac0c99affe523 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d67d4 expref: 9 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841813.754121:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92cbc57e3900) 00010000:00010000:0.0:1787841813.754138:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787841813.754538:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a400/0xe3dac0c99affe57e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841813.755413:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a400/0xe3dac0c99affe57e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841813.755433:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a400/0xe3dac0c99affe57e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841813.760488:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d200/0xe3dac0c99affe585 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841813.760525:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d200/0xe3dac0c99affe585 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841813.761187:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d200/0xe3dac0c99affe585 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787841813.772965:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1787841813.772995:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a400/0xe3dac0c99affe57e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841813.773008:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a400/0xe3dac0c99affe57e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841813.773018:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a400/0xe3dac0c99affe57e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841813.773025:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbffa3a400 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:0.0:1787841813.773031:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a400/0xe3dac0c99affe57e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841813.773040:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a400/0xe3dac0c99affe57e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841813.773062:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92cbc57e3e00) 00010000:00010000:0.0:1787841813.773066:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841813.773073:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a400/0xe3dac0c99affe57e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841813.773080:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a400/0xe3dac0c99affe57e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787841813.773116:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d10a5fa1 reply state 000000000d96485c transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d200/0xe3dac0c99affe585 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841813.773126:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787841813.773274:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf90c0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+10:10287:x1874687695023872:12345-192.168.201.1@tcp:36:lfs.0 Request processed in 19668us (19853us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1787841813.773283:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 37 00010000:00010000:3.0:1787841813.784303:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d200/0xe3dac0c99affe585 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841813.784330:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d200/0xe3dac0c99affe585 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841813.784338:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d200/0xe3dac0c99affe585 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841813.784346:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cc00d9d200 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:3.0:1787841813.784352:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d200/0xe3dac0c99affe585 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841813.784361:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d200/0xe3dac0c99affe585 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841813.784386:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff92cbd1fc7d00) 00010000:00010000:3.0:1787841813.784390:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787841813.784396:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d200/0xe3dac0c99affe585 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841813.784403:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d200/0xe3dac0c99affe585 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841813.902356:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841813.903235:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695024000 00000100:00100000:2.0:1787841813.903254:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695024000 00000100:00100000:3.0:1787841813.903421:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 38 00000100:00100000:3.0:1787841813.903436:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf90c1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+9:10295:x1874687695024000:12345-192.168.201.1@tcp:101:lctl.0 00010000:00010000:3.0:1787841813.903474:0:9449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841813.903507:0:9449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169b600/0xe3dac0c99affe58c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d67f0 expref: -99 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841813.903686:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169ba00/0xe3dac0c99affe593 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841813.903724:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169ba00/0xe3dac0c99affe593 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841813.903742:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169ba00/0xe3dac0c99affe593 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787841813.903836:0:9449:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787841813.903841:0:9449:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787841813.903895:0:9449:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169ba00/0xe3dac0c99affe593 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841813.904400:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169b600/0xe3dac0c99affe58c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d67f0 expref: 11 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841813.904427:0:9449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169ba00/0xe3dac0c99affe593 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d67f0 expref: 10 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841813.904437:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92cbc89cd800) 00010000:00010000:3.0:1787841813.904441:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787841813.904445:0:9449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc169ba00, rc 0) 00000100:00100000:3.0:1787841813.904637:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf90c1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+10:10295:x1874687695024000:12345-192.168.201.1@tcp:101:lctl.0 Request processed in 1202us (2296us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841813.904647:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 38 00000100:00100000:3.0:1787841813.977387:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841813.977664:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695024128 00000100:00100000:1.0:1787841813.977677:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695024128 00000100:00100000:1.0:1787841813.978174:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 39 00000100:00100000:1.0:1787841813.978185:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbd4bac3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2767a54-6703-4908-8414-eab6601e2ceb+10:10301:x1874687695024128:12345-192.168.201.1@tcp:101:bash.0 00010000:00010000:1.0:1787841813.978211:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841813.978237:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9da00/0xe3dac0c99affe59a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d67f7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841813.978330:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d800/0xe3dac0c99affe5a1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841813.978346:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d800/0xe3dac0c99affe5a1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841813.978358:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d800/0xe3dac0c99affe5a1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841813.978372:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affe5a8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841813.978378:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affe5a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841813.978383:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affe5a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841813.978518:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c000/0xe3dac0c99affe5af lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841813.978526:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c000/0xe3dac0c99affe5af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841813.978533:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c000/0xe3dac0c99affe5af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787841813.978584:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:1.0:1787841813.978588:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787841813.978644:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c000/0xe3dac0c99affe5af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841813.978671:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d800/0xe3dac0c99affe5a1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841813.978678:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d800/0xe3dac0c99affe5a1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841813.978685:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d800/0xe3dac0c99affe5a1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841813.978691:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cc00d9d800 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:1.0:1787841813.978722:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d800/0xe3dac0c99affe5a1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841813.978732:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d800/0xe3dac0c99affe5a1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841813.978747:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92cbc89cd800) 00010000:00010000:1.0:1787841813.978750:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787841813.978756:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d800/0xe3dac0c99affe5a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841813.978762:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d800/0xe3dac0c99affe5a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841813.978787:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affe5a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841813.978793:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affe5a8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841813.978798:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affe5a8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841813.978808:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cc00d9d600 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:1.0:1787841813.978811:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affe5a8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841813.978817:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affe5a8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841813.978826:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff92cbd1fc7900) 00010000:00010000:1.0:1787841813.978828:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787841813.978831:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affe5a8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841813.978836:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affe5a8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841813.978883:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9da00/0xe3dac0c99affe59a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d67f7 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841813.978897:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c000/0xe3dac0c99affe5af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d67f7 expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841813.978905:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92cbd1fc7300) 00010000:00010000:1.0:1787841813.978908:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787841813.978910:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cc00d9c000, rc 0) 00000100:00100000:1.0:1787841813.979315:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbd4bac3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2767a54-6703-4908-8414-eab6601e2ceb+11:10301:x1874687695024128:12345-192.168.201.1@tcp:101:bash.0 Request processed in 1131us (1942us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841813.979324:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 39 00000100:00100000:1.0:1787841813.984390:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841813.984658:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695024384 00000100:00100000:2.0:1787841813.984675:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695024384 00000100:00100000:2.0:1787841813.985265:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 40 00000100:00100000:2.0:1787841813.985279:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf90c1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+11:10301:x1874687695024384:12345-192.168.201.1@tcp:101:bash.0 00010000:00010000:2.0:1787841813.985314:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841813.985346:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598200/0xe3dac0c99affe5b6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d67fe expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841813.985597:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598e00/0xe3dac0c99affe5bd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841813.985618:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598e00/0xe3dac0c99affe5bd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841813.985636:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598e00/0xe3dac0c99affe5bd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841813.987739:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599800/0xe3dac0c99affe5c4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841813.987780:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599800/0xe3dac0c99affe5c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841813.987822:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599800/0xe3dac0c99affe5c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787841813.988449:0:5837:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:2.0:1787841813.988633:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599000/0xe3dac0c99affe5cb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841813.988645:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599000/0xe3dac0c99affe5cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841813.988655:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599000/0xe3dac0c99affe5cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841813.988690:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598e00/0xe3dac0c99affe5bd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841813.988730:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598e00/0xe3dac0c99affe5bd lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841813.988738:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598e00/0xe3dac0c99affe5bd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841813.988744:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6598e00 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:2.0:1787841813.988749:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598e00/0xe3dac0c99affe5bd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841813.988757:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598e00/0xe3dac0c99affe5bd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841813.989488:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92cbd1fc7300) 00010000:00010000:2.0:1787841813.989494:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787841813.989508:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598e00/0xe3dac0c99affe5bd lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841813.989516:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598e00/0xe3dac0c99affe5bd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787841813.989535:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002e3e9afe reply state 00000000d71cf136 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599800/0xe3dac0c99affe5c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841813.989543:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787841813.989586:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598200/0xe3dac0c99affe5b6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d67fe expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841813.989602:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599000/0xe3dac0c99affe5cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d67fe expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841813.989609:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92cbc3b04d00) 00010000:00010000:2.0:1787841813.989612:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787841813.989615:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc6599000, rc 0) 00000100:00100000:2.0:1787841813.989748:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf90c1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+14:10301:x1874687695024384:12345-192.168.201.1@tcp:101:bash.0 Request processed in 4472us (5376us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1787841813.989765:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 40 00010000:00010000:2.0:1787841813.992390:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599800/0xe3dac0c99affe5c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841813.992406:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599800/0xe3dac0c99affe5c4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841813.992414:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599800/0xe3dac0c99affe5c4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841813.992438:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6599800 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:2.0:1787841813.992442:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599800/0xe3dac0c99affe5c4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841813.992449:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599800/0xe3dac0c99affe5c4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841813.992466:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff92cbc3b04800) 00010000:00010000:2.0:1787841813.992469:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787841813.992473:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599800/0xe3dac0c99affe5c4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841813.992478:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599800/0xe3dac0c99affe5c4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841813.994022:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841813.994167:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695024512 00000100:00100000:2.0:1787841813.994181:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695024512 00000100:00100000:2.0:1787841813.994292:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 21 00000100:00100000:2.0:1787841813.994302:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf90c21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2353:x1874687695024512:12345-192.168.201.1@tcp:8:bash.0 00010000:00080000:2.0:1787841813.994349:0:6686:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from b2767a54-6703-4908-8414-eab6601e2ceb@192.168.201.1@tcp t0 exp 0000000000000000 cur 353 last 0 00000020:00000080:2.0:1787841813.994396:0:6686:0:(genops.c:1385:class_connect()) connect: client b2767a54-6703-4908-8414-eab6601e2ceb, cookie 0xe3dac0c99affe5d9 00002000:00100000:2.0:1787841813.994411:0:6686:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli b2767a54-6703-4908-8414-eab6601e2ceb/ffff92cbf6eb7000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211395f ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787841813.994443:0:6686:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787841813.994814:0:6686:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787841813.994855:0:6686:0:(import.c:65:import_set_state_nolock()) ffff92cbf6eb3800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787841813.995237:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf90c21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b2767a54-6703-4908-8414-eab6601e2ceb+6:2353:x1874687695024512:12345-192.168.201.1@tcp:8:bash.0 Request processed in 933us (1228us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841813.995266:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 21 00000100:00100000:3.0:1787841813.997848:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841813.998861:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695024640 00000100:00100000:0.0:1787841813.998876:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695024640 00000100:00100000:0.0:1787841813.998978:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 22 00000100:00100000:0.0:1787841813.998990:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbd4bae1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b2767a54-6703-4908-8414-eab6601e2ceb+6:0:x1874687695024640:12345-192.168.201.1@tcp:101:bash.0 00010000:00010000:0.0:1787841813.999016:0:6687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841813.999049:0:6687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000096c683fd/0xe3dac0c99affe5e0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6805 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787841813.999085:0:6687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787841813.999111:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=353s v=(0 0) 00010000:00010000:0.0:1787841813.999116:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787841813.999128:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096c683fd/0xe3dac0c99affe5e0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6805 expref: 7 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841813.999155:0:6687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000096c683fd/0xe3dac0c99affe5e0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6805 expref: 7 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841813.999173:0:6687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbffa3a400, rc 0) 00000100:00100000:0.0:1787841813.999248:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbd4bae1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b2767a54-6703-4908-8414-eab6601e2ceb+7:0:x1874687695024640:12345-192.168.201.1@tcp:101:bash.0 Request processed in 260us (1411us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841813.999267:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 22 00000100:00080000:3.0:1787841813.999945:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787841814.002226:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841814.002407:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695024768 00000100:00100000:0.0:1787841814.002419:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695024768 00000100:00100000:0.0:1787841814.002495:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 23 00000100:00100000:0.0:1787841814.002508:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbd4bad2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b2767a54-6703-4908-8414-eab6601e2ceb+7:10301:x1874687695024768:12345-192.168.201.1@tcp:101:bash.0 00010000:00010000:0.0:1787841814.002533:0:6687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841814.002572:0:6687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d8a27fac/0xe3dac0c99affe5e7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d680c expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841814.002615:0:6687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000096c683fd/0xe3dac0c99affe5e0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6805 expref: 8 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841814.002627:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787841814.002632:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787841814.002638:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8a27fac/0xe3dac0c99affe5e7 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d680c expref: 8 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841814.002683:0:6687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000096c683fd/0xe3dac0c99affe5e0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6805 expref: 8 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841814.002742:0:6687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000096c683fd/0xe3dac0c99affe5e0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6805 expref: 8 pid: 6687 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841814.002759:0:6687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbcd7a1680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6687:1874687714984704:192.168.201.1@tcp:104: 00000100:00100000:0.0:1787841814.002882:0:6687:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc2e593c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787841814.005578:0:6687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbcd7a1680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6687:1874687714984704:192.168.201.1@tcp:104: 00010000:00010000:3.0:1787841814.005625:0:6687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d8a27fac/0xe3dac0c99affe5e7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d680c expref: 8 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841814.005650:0:6687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbffa3b600, rc 0) 00000100:00100000:3.0:1787841814.005751:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbd4bad2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b2767a54-6703-4908-8414-eab6601e2ceb+8:10301:x1874687695024768:12345-192.168.201.1@tcp:101:bash.0 Request processed in 3246us (3533us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841814.005761:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 23 00000100:00100000:3.0:1787841814.009233:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841814.009323:0:7633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695024896 00000100:00100000:2.0:1787841814.009336:0:7633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695024896 00010000:00010000:2.0:1787841814.009395:0:7633:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000096c683fd/0xe3dac0c99affe5e0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6805 expref: 8 pid: 6687 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841814.009441:0:7633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 35 00000100:00100000:2.0:1787841814.009451:0:7633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbd4bac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b2767a54-6703-4908-8414-eab6601e2ceb+8:2357:x1874687695024896:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787841814.009479:0:7633:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787841814.009510:0:7633:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: 0000000096c683fd/0xe3dac0c99affe5e0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6805 expref: 8 pid: 6687 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841814.009527:0:7633:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000096c683fd/0xe3dac0c99affe5e0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6805 expref: 8 pid: 6687 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841814.010029:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000096c683fd/0xe3dac0c99affe5e0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6805 expref: 8 pid: 6687 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841814.010053:0:7633:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1787841814.010058:0:7633:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787841814.010069:0:7633:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d8a27fac/0xe3dac0c99affe5e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d680c expref: 7 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841814.010082:0:7633:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8a27fac/0xe3dac0c99affe5e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d680c expref: 7 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841814.010152:0:7633:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d8a27fac/0xe3dac0c99affe5e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d680c expref: 7 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841814.010169:0:7633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e670c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:7633:1874687714984832:192.168.201.1@tcp:105: 00000100:00100000:2.0:1787841814.010320:0:7633:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc3896840 going to sleep for 11 seconds 00000100:00100000:2.0:1787841814.021788:0:7633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e670c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:7633:1874687714984832:192.168.201.1@tcp:105: 00010000:00010000:2.0:1787841814.021831:0:7633:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787841814.026662:0:7633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbd4bac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b2767a54-6703-4908-8414-eab6601e2ceb+7:2357:x1874687695024896:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 17193us (17426us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841814.026691:0:7633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 35 00000100:00100000:0.0:1787841814.030816:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841814.032455:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695025152 00000100:00100000:2.0:1787841814.032474:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695025152 00000100:00100000:3.0:1787841814.032797:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 6 00000100:00100000:3.0:1787841814.032810:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd7a3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b2767a54-6703-4908-8414-eab6601e2ceb+13:10301:x1874687695025152:12345-192.168.201.1@tcp:35:bash.0 00000100:00100000:3.0:1787841814.033401:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd7a3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b2767a54-6703-4908-8414-eab6601e2ceb+14:10301:x1874687695025152:12345-192.168.201.1@tcp:35:bash.0 Request processed in 590us (2601us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1787841814.033414:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 6 00010000:00010000:2.0:1787841814.082195:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787841814.132020:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841814.132423:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695025408 00000100:00100000:2.0:1787841814.132440:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695025408 00000100:00100000:2.0:1787841814.132534:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 41 00000100:00100000:2.0:1787841814.132557:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbd4bacb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+14:10311:x1874687695025408:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:2.0:1787841814.132591:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841814.132618:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598200/0xe3dac0c99affe5ee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6813 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787841814.132815:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1787841814.133393:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598200/0xe3dac0c99affe5ee lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6813 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841814.133438:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92cbc89cd800) 00010000:00010000:2.0:1787841814.133442:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787841814.133450:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598200/0xe3dac0c99affe5ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6813 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841814.133470:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc6598200, rc 0) 00000100:00100000:2.0:1787841814.134136:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbd4bacb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+15:10311:x1874687695025408:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 1577us (2127us total) trans 4294967313 rc 301/301 00000100:00100000:2.0:1787841814.134147:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 41 00000100:00100000:0.0:1787841814.138953:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841814.139113:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695025664 00000100:00100000:1.0:1787841814.139127:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695025664 00000100:00100000:1.0:1787841814.139192:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 7 00000100:00100000:1.0:1787841814.139202:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd7a30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b2767a54-6703-4908-8414-eab6601e2ceb+15:10311:x1874687695025664:12345-192.168.201.1@tcp:35:lfs.0 00000100:00100000:1.0:1787841814.139604:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd7a30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b2767a54-6703-4908-8414-eab6601e2ceb+16:10311:x1874687695025664:12345-192.168.201.1@tcp:35:lfs.0 Request processed in 401us (666us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1787841814.139612:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 7 00000100:00100000:0.0:1787841814.240642:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841814.241065:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695025792 00000100:00100000:3.0:1787841814.241078:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695025792 00000100:00100000:3.0:1787841814.241159:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 42 00000100:00100000:3.0:1787841814.241171:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd7a2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+16:10317:x1874687695025792:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:3.0:1787841814.241201:0:9449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841814.241228:0:9449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169b600/0xe3dac0c99affe5fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d681a expref: -99 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841814.241316:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169ac00/0xe3dac0c99affe603 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841814.241351:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169ac00/0xe3dac0c99affe603 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841814.241364:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169ac00/0xe3dac0c99affe603 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787841814.241448:0:9449:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:3.0:1787841814.241451:0:9449:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787841814.241481:0:9449:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169ac00/0xe3dac0c99affe603 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841814.241512:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169b600/0xe3dac0c99affe5fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d681a expref: 18 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841814.242477:0:9449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169ac00/0xe3dac0c99affe603 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d681a expref: 17 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841814.242493:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92cbd1fc7300) 00010000:00010000:3.0:1787841814.242496:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787841814.242501:0:9449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc169ac00, rc 0) 00000100:00100000:2.0:1787841814.243530:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd7a2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+17:10317:x1874687695025792:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 2355us (2894us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841814.243549:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 42 00000100:00100000:2.0:1787841814.247826:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841814.247969:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695026048 00000100:00100000:1.0:1787841814.247986:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695026048 00000100:00100000:1.0:1787841814.248072:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 43 00000100:00100000:1.0:1787841814.248084:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e670c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2767a54-6703-4908-8414-eab6601e2ceb+17:10317:x1874687695026048:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:1.0:1787841814.248112:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841814.248139:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9da00/0xe3dac0c99affe60a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6821 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.248280:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affe611 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.248298:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affe611 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.248313:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affe611 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787841814.248327:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787841814.248516:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9da00/0xe3dac0c99affe60a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6821 expref: 20 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.248584:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affe611 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6821 expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.248595:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92cbc3b04d00) 00010000:00010000:1.0:1787841814.248599:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787841814.248603:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cc00d9d600, rc 0) 00000100:00100000:1.0:1787841814.248692:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e670c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2767a54-6703-4908-8414-eab6601e2ceb+19:10317:x1874687695026048:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 611us (881us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1787841814.248729:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 43 00000100:00100000:3.0:1787841814.254005:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841814.254160:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695026304 00000100:00100000:1.0:1787841814.254173:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695026304 00000100:00100000:1.0:1787841814.254246:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 44 00000100:00100000:1.0:1787841814.254256:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbd4bae940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+19:10317:x1874687695026304:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:1.0:1787841814.254288:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841814.254312:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d800/0xe3dac0c99affe61f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6828 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.254441:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9dc00/0xe3dac0c99affe626 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.254458:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9dc00/0xe3dac0c99affe626 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.254472:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9dc00/0xe3dac0c99affe626 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787841814.254486:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787841814.254663:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d800/0xe3dac0c99affe61f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6828 expref: 22 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.254684:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9dc00/0xe3dac0c99affe626 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6828 expref: 21 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.254694:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92cbc3b04d00) 00010000:00010000:1.0:1787841814.254720:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787841814.254723:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cc00d9dc00, rc 0) 00000100:00100000:1.0:1787841814.254805:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbd4bae940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+21:10317:x1874687695026304:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 550us (817us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1787841814.254814:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 44 00000100:00100000:3.0:1787841814.264286:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841814.264354:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841814.264936:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695026560 00000100:00100000:0.0:1787841814.264951:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695026560 00000100:00100000:0.0:1787841814.265037:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 24 00000100:00100000:0.0:1787841814.265054:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff408f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b2767a54-6703-4908-8414-eab6601e2ceb+7:2356:x1874687695026560:12345-192.168.201.1@tcp:1:lfs.0 00010000:00010000:0.0:1787841814.265133:0:6688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000891689c2/0xe3dac0c99affe634 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841814.265162:0:6688:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d8a27fac/0xe3dac0c99affe5e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d680c expref: 7 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841814.265173:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787841814.265179:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787841814.265186:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000891689c2/0xe3dac0c99affe634 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841814.265244:0:6688:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d8a27fac/0xe3dac0c99affe5e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d680c expref: 7 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841814.265260:0:6688:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d8a27fac/0xe3dac0c99affe5e7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d680c expref: 7 pid: 6687 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841814.265277:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbcd7a12c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6688:1874687714984960:192.168.201.1@tcp:104: 00000100:00100000:0.0:1787841814.265400:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc2e593c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787841814.265774:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695026432 00000100:00100000:1.0:1787841814.265780:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695026432 00000100:00100000:1.0:1787841814.265832:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 2 00000100:00100000:1.0:1787841814.265840:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff40a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b2767a54-6703-4908-8414-eab6601e2ceb+21:2357:x1874687695026432:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787841814.265852:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787841814.265880:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affe611 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6821 expref: 21 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.265899:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92cbc3b04d00) 00010000:00010000:1.0:1787841814.265904:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787841814.265951:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff40a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b2767a54-6703-4908-8414-eab6601e2ceb+20:2357:x1874687695026432:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 111us (1684us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841814.265960:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 2 00000100:00100000:3.0:1787841814.275098:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbcd7a12c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6688:1874687714984960:192.168.201.1@tcp:104: 00010000:00010000:3.0:1787841814.275143:0:6688:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000891689c2/0xe3dac0c99affe634 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841814.284202:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841814.284262:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695026688 00000100:00100000:0.0:1787841814.284273:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695026688 00002000:00100000:0.0:1787841814.284327:0:6692:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff92cbcd7a03c0 x1874687695026688/t0(0) o4->b2767a54-6703-4908-8414-eab6601e2ceb@192.168.201.1@tcp:315/0 lens 504/0 e 0 to 0 dl 1787841825 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787841814.284337:0:6692:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff92cbcd7a03c0 with x1874687695026688 ext(0->12) 00010000:00010000:0.0:1787841814.284349:0:6692:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d8a27fac/0xe3dac0c99affe5e7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d680c expref: 8 pid: 6687 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841814.284368:0:6692:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d8a27fac/0xe3dac0c99affe5e7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d680c expref: 8 pid: 6687 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787841814.284378:0:6692:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92cbcd7a03c0 00000100:00100000:0.0:1787841814.284409:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 0 00000100:00100000:0.0:1787841814.284418:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd7a03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b2767a54-6703-4908-8414-eab6601e2ceb+8:2357:x1874687695026688:12345-192.168.201.1@tcp:4:lfs.0 00000001:00080000:3.0:1787841814.331368:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000001:00080000:3.0:1787841814.331420:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967316 is committed 00000001:00100000:3.0:1787841814.334577:0:7643:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b2767a54-6703-4908-8414-eab6601e2ceb 00000100:00100000:0.0:1787841814.376307:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd7a03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b2767a54-6703-4908-8414-eab6601e2ceb+9:2357:x1874687695026688:12345-192.168.201.1@tcp:4:lfs.0 Request processed in 91871us (92098us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1787841814.376329:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 0 00002000:00100000:0.0:1787841814.376348:0:6692:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff92cbcd7a03c0 x1874687695026688/t4294967299(0) o4->b2767a54-6703-4908-8414-eab6601e2ceb@192.168.201.1@tcp:315/0 lens 504/448 e 0 to 0 dl 1787841825 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787841814.376362:0:6692:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff92cbcd7a03c0 with x1874687695026688 ext(0->12) 00010000:00010000:0.0:1787841814.376378:0:6692:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d8a27fac/0xe3dac0c99affe5e7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d680c expref: 9 pid: 6687 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841814.376402:0:6692:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d8a27fac/0xe3dac0c99affe5e7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d680c expref: 9 pid: 6687 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787841814.376431:0:6692:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92cbcd7a03c0 00000001:00080000:3.0:1787841814.380060:0:7643:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:0.0:1787841814.380355:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841814.380439:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695026816 00000100:00100000:1.0:1787841814.380453:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695026816 00010000:00010000:1.0:1787841814.380519:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d8a27fac/0xe3dac0c99affe5e7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d680c expref: 7 pid: 6687 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841814.380579:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 36 00000100:00100000:1.0:1787841814.380591:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd7a12c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b2767a54-6703-4908-8414-eab6601e2ceb+7:2356:x1874687695026816:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787841814.380812:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787841814.380997:0:5823:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1787841814.381002:0:5823:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1787841814 00002000:00010000:1.0:1787841814.381004:0:5823:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1787841814 00002000:00010000:1.0:1787841814.381007:0:5823:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1787841814 00002000:00010000:1.0:1787841814.381010:0:5823:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:1.0:1787841814.381019:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d8a27fac/0xe3dac0c99affe5e7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d680c expref: 7 pid: 6687 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.381038:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d8a27fac/0xe3dac0c99affe5e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d680c expref: 7 pid: 6687 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.381070:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d8a27fac/0xe3dac0c99affe5e7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d680c expref: 7 pid: 6687 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.381095:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787841814.381100:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787841814.381106:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000891689c2/0xe3dac0c99affe634 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.381117:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000891689c2/0xe3dac0c99affe634 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.381171:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787841814.381244:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd7a12c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b2767a54-6703-4908-8414-eab6601e2ceb+6:2356:x1874687695026816:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 656us (895us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841814.381253:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 36 00010000:00010000:3.0:1787841814.382033:0:6688:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000891689c2/0xe3dac0c99affe634 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841814.382047:0:6688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000891689c2/0xe3dac0c99affe634 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841814.382084:0:6688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000891689c2/0xe3dac0c99affe634 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841814.382093:0:6688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000891689c2/0xe3dac0c99affe634 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841814.382102:0:6688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000891689c2/0xe3dac0c99affe634 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841814.382111:0:6688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbffa3b800 already unused, calling callback (ffffffffc17a4500) 00010000:00010000:3.0:1787841814.382116:0:6688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000891689c2/0xe3dac0c99affe634 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841814.382127:0:6688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000891689c2/0xe3dac0c99affe634 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841814.382146:0:6688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000891689c2/0xe3dac0c99affe634 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841814.382170:0:6688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000891689c2/0xe3dac0c99affe634 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841814.382261:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff408f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b2767a54-6703-4908-8414-eab6601e2ceb+5:2356:x1874687695026560:12345-192.168.201.1@tcp:1:lfs.0 Request processed in 117211us (117905us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841814.382272:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 24 00000100:00100000:0.0:1787841814.386101:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841814.386192:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695027072 00000100:00100000:1.0:1787841814.386205:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695027072 00000100:00100000:1.0:1787841814.386280:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 8 00000100:00100000:1.0:1787841814.386293:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd7a1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b2767a54-6703-4908-8414-eab6601e2ceb+12:10317:x1874687695027072:12345-192.168.201.1@tcp:35:lfs.0 00000004:00010000:1.0:1787841814.386387:0:5840:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9dc00/0xe3dac0c99affe626 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6828 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787841814.387098:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:1.0:1787841814.387161:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:1.0:1787841814.389446:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:1.0:1787841814.389685:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affe63b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.391130:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599000/0xe3dac0c99affe5cb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d67fe expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.391147:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affe63b lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.391213:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599000/0xe3dac0c99affe5cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d67fe expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.391233:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599000/0xe3dac0c99affe5cb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d67fe expref: 16 pid: 5837 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841814.391265:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf90c0f00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5840:1874687714985088:192.168.201.1@tcp:104: 00000100:00100000:1.0:1787841814.391531:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cac3324000 going to sleep for 11 seconds 00000100:00100000:2.0:1787841814.395772:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841814.396197:0:7633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695027200 00000100:00100000:0.0:1787841814.396211:0:7633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695027200 00010000:00010000:0.0:1787841814.396276:0:7633:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599000/0xe3dac0c99affe5cb lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d67fe expref: 17 pid: 5837 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841814.396336:0:7633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 37 00000100:00100000:0.0:1787841814.396347:0:7633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e65e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b2767a54-6703-4908-8414-eab6601e2ceb+17:2356:x1874687695027200:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787841814.396368:0:7633:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787841814.396376:0:7633:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599000/0xe3dac0c99affe5cb lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d67fe expref: 17 pid: 5837 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841814.396393:0:7633:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599000/0xe3dac0c99affe5cb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d67fe expref: 17 pid: 5837 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841814.396426:0:7633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92cbc3b04d00) 00010000:00010000:0.0:1787841814.396433:0:7633:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affe63b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841814.396445:0:7633:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affe63b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841814.396455:0:7633:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affe63b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841814.396500:0:7633:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787841814.396580:0:7633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e65e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b2767a54-6703-4908-8414-eab6601e2ceb+17:2356:x1874687695027200:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 235us (832us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841814.396590:0:7633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 37 00010000:00010000:1.0:1787841814.396855:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599000/0xe3dac0c99affe5cb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d67fe expref: 16 pid: 5837 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841814.397272:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf90c0f00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5840:1874687714985088:192.168.201.1@tcp:104: 00010000:00010000:1.0:1787841814.397302:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affe63b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.397312:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affe63b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.397318:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affe63b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787841814.397493:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:1.0:1787841814.398151:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:1.0:1787841814.398307:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf90c0f00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5840:1874687714985216:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787841814.398393:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841814.398435:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cac3324900 going to sleep for 11 seconds 00000100:00100000:2.0:1787841814.398542:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714985216 00000100:00100000:2.0:1787841814.398551:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714985216 00000100:00100000:2.0:1787841814.398627:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787841814.398638:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf90c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5840:x1874687714985216:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787841814.398755:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf90c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5840:x1874687714985216:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 119us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841814.398772:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787841814.398819:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf90c0f00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5840:1874687714985216:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1787841814.399565:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:2.0:1787841814.399639:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e66580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5840:1874687714985344:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787841814.399694:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841814.399748:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714985344 00000100:00100000:2.0:1787841814.399754:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714985344 00000100:00100000:2.0:1787841814.399790:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787841814.399798:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5840:x1874687714985344:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787841814.400049:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5840:x1874687714985344:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 251us (355us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1787841814.400057:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787841814.400081:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbf0518480 going to sleep for 11 seconds 00000100:00100000:2.0:1787841814.400106:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e66580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5840:1874687714985344:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1787841814.400151:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:2.0:1787841814.400192:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affe63b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841814.400205:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affe63b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841814.400214:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affe63b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841814.400221:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cc00d9d600 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:2.0:1787841814.400228:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affe63b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841814.400238:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affe63b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841814.400259:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92cbc3b04d00) 00010000:00010000:2.0:1787841814.400262:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787841814.400275:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affe63b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841814.400282:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affe63b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787841814.400493:0:5840:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787841814.400772:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1787841814.400788:0:5840:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 354399089121ns, next at 355399086499ns, rc = 0 00000001:00080000:2.0:1787841814.400796:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:2.0:1787841814.400830:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92cbc3b04d00) 00010000:00010000:2.0:1787841814.400834:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787841814.400842:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9dc00/0xe3dac0c99affe626 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6828 expref: 20 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841814.400951:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd7a1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b2767a54-6703-4908-8414-eab6601e2ceb+19:10317:x1874687695027072:12345-192.168.201.1@tcp:35:lfs.0 Request processed in 14660us (14863us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1787841814.400960:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 8 00000020:00080000:2.0:1787841814.400965:0:5840:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00080000:1.0:1787841814.401281:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787841814.404510:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841814.404688:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695027328 00000100:00100000:1.0:1787841814.404773:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695027328 00000100:00100000:1.0:1787841814.404932:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 45 00000100:00100000:1.0:1787841814.404946:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e67c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2767a54-6703-4908-8414-eab6601e2ceb+19:10317:x1874687695027328:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:1.0:1787841814.404981:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841814.405032:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d800/0xe3dac0c99affe642 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d682f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.405123:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d800/0xe3dac0c99affe642 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d682f expref: 20 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.405142:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d800/0xe3dac0c99affe642 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d682f expref: 20 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.405167:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92cbd1fc7c00) 00010000:00010000:1.0:1787841814.405171:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787841814.405176:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cc00d9d800, rc 0) 00000100:00100000:1.0:1787841814.405304:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e67c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2767a54-6703-4908-8414-eab6601e2ceb+20:10317:x1874687695027328:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 361us (807us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841814.405312:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 45 00000100:00100000:0.0:1787841814.408139:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841814.408229:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695027584 00000100:00100000:3.0:1787841814.408241:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695027584 00000100:00100000:3.0:1787841814.408307:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 9 00000100:00100000:3.0:1787841814.408318:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbc6c30050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b2767a54-6703-4908-8414-eab6601e2ceb+20:10317:x1874687695027584:12345-192.168.201.1@tcp:35:lfs.0 00000100:00100000:3.0:1787841814.408935:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbc6c30050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b2767a54-6703-4908-8414-eab6601e2ceb+21:10317:x1874687695027584:12345-192.168.201.1@tcp:35:lfs.0 Request processed in 617us (807us total) trans 4294967326 rc 0/0 00000100:00100000:3.0:1787841814.408943:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 9 00000100:00100000:3.0:1787841814.477840:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841814.478002:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695027840 00000100:00100000:1.0:1787841814.478015:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695027840 00000100:00100000:1.0:1787841814.478089:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 46 00000100:00100000:1.0:1787841814.478100:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff40b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+21:10327:x1874687695027840:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:1.0:1787841814.478134:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841814.478158:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9da00/0xe3dac0c99affe649 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6836 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787841814.478488:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:1.0:1787841814.478677:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9da00/0xe3dac0c99affe649 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6836 expref: 23 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.478744:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92cbc89cd800) 00010000:00010000:1.0:1787841814.478755:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787841814.478775:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9da00/0xe3dac0c99affe649 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6836 expref: 23 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.478791:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cc00d9da00, rc 0) 00000100:00100000:1.0:1787841814.478863:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff40b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+22:10327:x1874687695027840:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 764us (1038us total) trans 4294967327 rc 301/301 00000100:00100000:1.0:1787841814.478871:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 46 00000100:00100000:2.0:1787841814.483729:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841814.483871:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695027968 00000100:00100000:1.0:1787841814.483885:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695027968 00000100:00100000:1.0:1787841814.483984:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 47 00000100:00100000:1.0:1787841814.483998:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf04c3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+22:10327:x1874687695027968:12345-192.168.201.1@tcp:34:lfs.0 00010000:00010000:1.0:1787841814.484122:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99affe657 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.484149:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99affe657 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.484166:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99affe657 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.484185:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affe65e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.484194:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affe65e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.484201:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affe65e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.484602:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c600/0xe3dac0c99affe665 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.484621:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c600/0xe3dac0c99affe665 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.484629:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c600/0xe3dac0c99affe665 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787841814.484689:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c600/0xe3dac0c99affe665 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.484743:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99affe657 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.484750:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99affe657 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.484756:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99affe657 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.484774:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cc00d9d400 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:1.0:1787841814.484779:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99affe657 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.484787:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99affe657 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.484800:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92cbd1fc7300) 00010000:00010000:1.0:1787841814.484803:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787841814.484807:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99affe657 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.484815:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99affe657 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.484838:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affe65e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.484844:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affe65e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.484850:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affe65e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.484855:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cc00d9de00 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:1.0:1787841814.484858:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affe65e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.484864:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affe65e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.484872:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff92cbd1fc7900) 00010000:00010000:1.0:1787841814.484874:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787841814.484877:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affe65e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.484883:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affe65e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.484896:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c600/0xe3dac0c99affe665 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.484903:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c600/0xe3dac0c99affe665 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.484908:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c600/0xe3dac0c99affe665 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.484919:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cc00d9c600 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:1.0:1787841814.484923:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c600/0xe3dac0c99affe665 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.484929:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c600/0xe3dac0c99affe665 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.484938:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92cbd1fc7c00) 00010000:00010000:1.0:1787841814.484940:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787841814.484943:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c600/0xe3dac0c99affe665 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.484948:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c600/0xe3dac0c99affe665 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841814.485064:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf04c3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+22:10327:x1874687695027968:12345-192.168.201.1@tcp:34:lfs.0 Request processed in 1066us (1373us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841814.485074:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 47 00000100:00100000:0.0:1787841814.488075:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841814.488227:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695028224 00000100:00100000:2.0:1787841814.488242:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695028224 00000100:00100000:2.0:1787841814.488319:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 10 00000100:00100000:2.0:1787841814.488332:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd7a1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b2767a54-6703-4908-8414-eab6601e2ceb+22:10327:x1874687695028224:12345-192.168.201.1@tcp:35:lfs.0 00000100:00100000:2.0:1787841814.489414:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd7a1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b2767a54-6703-4908-8414-eab6601e2ceb+23:10327:x1874687695028224:12345-192.168.201.1@tcp:35:lfs.0 Request processed in 1080us (1352us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1787841814.489426:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 10 00000100:00100000:2.0:1787841814.536377:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841814.536503:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695028480 00000100:00100000:1.0:1787841814.536515:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695028480 00000100:00100000:1.0:1787841814.536594:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 48 00000100:00100000:1.0:1787841814.536606:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf04c1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+23:10330:x1874687695028480:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:1.0:1787841814.536641:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841814.536669:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c600/0xe3dac0c99affe66c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d683d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.536847:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affe673 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.536888:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affe673 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.536904:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affe673 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.536929:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99affe67a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.536937:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99affe67a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.536943:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99affe67a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.537327:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c400/0xe3dac0c99affe681 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.537336:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c400/0xe3dac0c99affe681 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.537343:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c400/0xe3dac0c99affe681 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787841814.537356:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787841814.537483:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affe673 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.537492:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affe673 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.537500:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affe673 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.537514:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cc00d9de00 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:1.0:1787841814.537520:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affe673 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.537529:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affe673 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.537546:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92cbd1fc7300) 00010000:00010000:1.0:1787841814.537550:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787841814.537557:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affe673 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.537565:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affe673 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.537583:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99affe67a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.537590:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99affe67a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.537597:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99affe67a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.537602:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cc00d9d400 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:1.0:1787841814.537605:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99affe67a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.537612:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99affe67a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.537630:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff92cbd1fc7900) 00010000:00010000:1.0:1787841814.537633:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787841814.537636:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99affe67a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.537643:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99affe67a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.537748:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c600/0xe3dac0c99affe66c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d683d expref: 26 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.537774:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c400/0xe3dac0c99affe681 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d683d expref: 25 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841814.537783:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92cbd1fc7c00) 00010000:00010000:1.0:1787841814.537785:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787841814.537787:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cc00d9c400, rc 0) 00000100:00100000:1.0:1787841814.539423:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf04c1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+25:10330:x1874687695028480:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 2807us (3050us total) trans 4294967329 rc 0/0 00000100:00100000:1.0:1787841814.539437:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 48 00000100:00100000:1.0:1787841814.543210:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841814.543320:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695028608 00000100:00100000:2.0:1787841814.543334:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695028608 00000100:00100000:2.0:1787841814.543407:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 49 00000100:00100000:2.0:1787841814.543419:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf90c3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+25:10330:x1874687695028608:12345-192.168.201.1@tcp:54:lfs.0 00010000:00010000:2.0:1787841814.543511:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599a00/0xe3dac0c99affe68f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841814.543531:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599a00/0xe3dac0c99affe68f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841814.543545:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599a00/0xe3dac0c99affe68f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841814.543583:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599a00/0xe3dac0c99affe68f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841814.543589:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599a00/0xe3dac0c99affe68f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841814.543596:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599a00/0xe3dac0c99affe68f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841814.543602:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6599a00 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:2.0:1787841814.543607:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599a00/0xe3dac0c99affe68f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841814.543616:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599a00/0xe3dac0c99affe68f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841814.543630:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92cbd1fc7c00) 00010000:00010000:2.0:1787841814.543633:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787841814.543638:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599a00/0xe3dac0c99affe68f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841814.543664:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599a00/0xe3dac0c99affe68f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841814.543810:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf90c3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+25:10330:x1874687695028608:12345-192.168.201.1@tcp:54:lfs.0 Request processed in 393us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841814.543819:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 49 00000100:00100000:0.0:1787841814.548298:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841814.548568:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695028864 00000100:00100000:2.0:1787841814.548580:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695028864 00000100:00100000:2.0:1787841814.548650:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 11 00000100:00100000:2.0:1787841814.548659:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd7a2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b2767a54-6703-4908-8414-eab6601e2ceb+25:10330:x1874687695028864:12345-192.168.201.1@tcp:35:lfs.0 00000100:00100000:2.0:1787841814.549568:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd7a2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b2767a54-6703-4908-8414-eab6601e2ceb+26:10330:x1874687695028864:12345-192.168.201.1@tcp:35:lfs.0 Request processed in 905us (1292us total) trans 4294967330 rc 0/0 00000100:00100000:2.0:1787841814.549578:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 11 00000100:00100000:0.0:1787841814.924270:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841814.924532:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695029120 00000100:00100000:3.0:1787841814.924554:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695029120 00000100:00100000:3.0:1787841814.924678:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 50 00000100:00100000:3.0:1787841814.924691:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd7a3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+26:10361:x1874687695029120:12345-192.168.201.1@tcp:101:cat.0 00010000:00010000:3.0:1787841814.924781:0:9449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841814.924810:0:9449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149de00/0xe3dac0c99affe696 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6844 expref: -99 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841814.924946:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affe69d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841814.925049:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affe69d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841814.925064:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affe69d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787841814.925078:0:9449:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1787841814.925256:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149de00/0xe3dac0c99affe696 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6844 expref: 29 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841814.925279:0:9449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affe69d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6844 expref: 28 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841814.925288:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92cbd1fc7c00) 00010000:00010000:3.0:1787841814.925292:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787841814.925296:0:9449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc149c000, rc 0) 00000100:00100000:3.0:1787841814.925375:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd7a3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+28:10361:x1874687695029120:12345-192.168.201.1@tcp:101:cat.0 Request processed in 687us (1119us total) trans 4294967331 rc 0/0 00000100:00100000:3.0:1787841814.925383:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 50 00000100:00100000:1.0:1787841814.930092:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841814.930152:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841814.930312:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695029376 00000100:00100000:0.0:1787841814.930326:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695029376 00000100:00100000:0.0:1787841814.930413:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 12 00000100:00100000:0.0:1787841814.930426:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf90c1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b2767a54-6703-4908-8414-eab6601e2ceb+28:10361:x1874687695029376:12345-192.168.201.1@tcp:35:cat.0 00000100:00100000:0.0:1787841814.930814:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf90c1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b2767a54-6703-4908-8414-eab6601e2ceb+29:10361:x1874687695029376:12345-192.168.201.1@tcp:35:cat.0 Request processed in 389us (741us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1787841814.930822:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 12 00000100:00100000:2.0:1787841814.933817:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695029504 00000100:00100000:2.0:1787841814.934134:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695029504 00000100:00100000:2.0:1787841814.934288:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 3 00000100:00100000:2.0:1787841814.934301:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcdb7a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b2767a54-6703-4908-8414-eab6601e2ceb+29:2357:x1874687695029504:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787841814.934325:0:7632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787841814.934454:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affe69d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6844 expref: 29 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841814.934480:0:7632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92cbd1fc7c00) 00010000:00010000:2.0:1787841814.934486:0:7632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787841814.934657:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcdb7a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b2767a54-6703-4908-8414-eab6601e2ceb+28:2357:x1874687695029504:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 359us (4503us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841814.934666:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 3 00000100:00100000:0.0:1787841815.029011:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841815.029194:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695029760 00000100:00100000:2.0:1787841815.029208:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695029760 00000100:00100000:2.0:1787841815.029309:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 51 00000100:00100000:2.0:1787841815.029320:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd7a30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+28:10367:x1874687695029760:12345-192.168.201.1@tcp:101:dd.0 00010000:00010000:2.0:1787841815.029356:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841815.029360:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787841815.029400:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169ac00/0xe3dac0c99affe603 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d681a expref: 28 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841815.029426:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92cbd1fc7300) 00010000:00010000:2.0:1787841815.029433:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787841815.029451:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599a00/0xe3dac0c99affe6ab lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d684b expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841815.029584:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598c00/0xe3dac0c99affe6b2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841815.029601:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c400/0xe3dac0c99affe681 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d683d expref: 28 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841815.029611:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598c00/0xe3dac0c99affe6b2 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841815.029654:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c400/0xe3dac0c99affe681 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d683d expref: 28 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841815.029669:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c400/0xe3dac0c99affe681 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d683d expref: 28 pid: 5837 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841815.029783:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf04c2580 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1874687714985472:192.168.201.1@tcp:104: 00000100:00100000:2.0:1787841815.029907:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbf0518d80 going to sleep for 11 seconds 00000100:00080000:1.0:1787841815.029986:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787841815.034119:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf04c2580 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1874687714985472:192.168.201.1@tcp:104: 00010000:00010000:2.0:1787841815.034172:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598c00/0xe3dac0c99affe6b2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841815.034232:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841815.034377:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695029888 00000100:00100000:1.0:1787841815.034387:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695029888 00010000:00010000:1.0:1787841815.034447:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c400/0xe3dac0c99affe681 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d683d expref: 29 pid: 5837 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841815.034529:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 38 00000100:00100000:1.0:1787841815.034543:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd7a1680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b2767a54-6703-4908-8414-eab6601e2ceb+29:2357:x1874687695029888:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787841815.034570:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787841815.034579:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c400/0xe3dac0c99affe681 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d683d expref: 29 pid: 5837 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841815.034594:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c400/0xe3dac0c99affe681 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d683d expref: 29 pid: 5837 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841815.034627:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c400/0xe3dac0c99affe681 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d683d expref: 29 pid: 5837 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841815.034648:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92cbd1fc7c00) 00010000:00010000:1.0:1787841815.034653:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598c00/0xe3dac0c99affe6b2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841815.034666:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598c00/0xe3dac0c99affe6b2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841815.034676:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598c00/0xe3dac0c99affe6b2 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841815.034742:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787841815.035100:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd7a1680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b2767a54-6703-4908-8414-eab6601e2ceb+28:2357:x1874687695029888:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 558us (867us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841815.035110:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 38 00010000:00010000:2.0:1787841815.036109:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598c00/0xe3dac0c99affe6b2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841815.036127:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598c00/0xe3dac0c99affe6b2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787841815.036156:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787841815.036418:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599a00/0xe3dac0c99affe6ab lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d684b expref: 29 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841815.036446:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598c00/0xe3dac0c99affe6b2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d684b expref: 28 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841815.036456:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92cbd1fc7c00) 00010000:00010000:2.0:1787841815.036459:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787841815.036464:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc6598c00, rc 0) 00000100:00100000:2.0:1787841815.036536:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd7a30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+28:10367:x1874687695029760:12345-192.168.201.1@tcp:101:dd.0 Request processed in 7218us (7540us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1787841815.036546:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 51 00000100:00100000:1.0:1787841815.058308:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841815.058442:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695030144 00000100:00100000:2.0:1787841815.058465:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695030144 00000100:00100000:2.0:1787841815.058568:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 52 00000100:00100000:2.0:1787841815.058580:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf90c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+28:10367:x1874687695030144:12345-192.168.201.1@tcp:36:dd.0 00010000:00010000:2.0:1787841815.060189:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599000/0xe3dac0c99affe6c0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841815.060221:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599000/0xe3dac0c99affe6c0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841815.060240:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599000/0xe3dac0c99affe6c0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787841815.060363:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:2.0:1787841815.060407:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000aa1f3249 reply state 000000004cd272fe transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599000/0xe3dac0c99affe6c0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841815.060418:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787841815.060903:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf90c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+31:10367:x1874687695030144:12345-192.168.201.1@tcp:36:dd.0 Request processed in 2317us (2605us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1787841815.060914:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 52 00000020:00080000:2.0:1787841815.060921:0:5837:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787841815.068723:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599000/0xe3dac0c99affe6c0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841815.068748:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599000/0xe3dac0c99affe6c0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841815.068766:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599000/0xe3dac0c99affe6c0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841815.068772:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6599000 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:3.0:1787841815.068798:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599000/0xe3dac0c99affe6c0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841815.068808:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599000/0xe3dac0c99affe6c0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841815.068840:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92cbd1fc7c00) 00010000:00010000:3.0:1787841815.068844:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787841815.068851:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599000/0xe3dac0c99affe6c0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841815.068857:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599000/0xe3dac0c99affe6c0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841815.105643:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787841815.445328:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841815.450287:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695030272 00000100:00100000:3.0:1787841815.450308:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695030272 00000100:00100000:3.0:1787841815.450461:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 53 00000100:00100000:3.0:1787841815.450491:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf90c30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2767a54-6703-4908-8414-eab6601e2ceb+30:10381:x1874687695030272:12345-192.168.201.1@tcp:101:stat.0 00010000:00010000:3.0:1787841815.450555:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841815.450586:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149de00/0xe3dac0c99affe6c7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6852 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841815.450728:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affe6ce lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841815.450757:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affe6ce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841815.450772:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affe6ce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841815.450808:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affe6d5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841815.451099:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affe6d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841815.451108:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affe6d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841815.452169:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affe6dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841815.452189:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598c00/0xe3dac0c99affe6b2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d684b expref: 31 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841815.452199:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affe6dc lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841815.452246:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598c00/0xe3dac0c99affe6b2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d684b expref: 31 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841815.452265:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598c00/0xe3dac0c99affe6b2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d684b expref: 31 pid: 5839 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841815.452282:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff40a580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5838:1874687714985600:192.168.201.1@tcp:104: 00000100:00100000:3.0:1787841815.452724:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc6726240 going to sleep for 11 seconds 00000100:00100000:3.0:1787841815.460371:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff40a580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5838:1874687714985600:192.168.201.1@tcp:104: 00010000:00010000:3.0:1787841815.460415:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affe6dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841815.461161:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841815.461392:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695030528 00000100:00100000:0.0:1787841815.461401:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695030528 00000100:00100000:0.0:1787841815.461551:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 13 00000100:00100000:0.0:1787841815.461564:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf90c2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b2767a54-6703-4908-8414-eab6601e2ceb+32:5604:x1874687695030528:12345-192.168.201.1@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787841815.462089:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf90c2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b2767a54-6703-4908-8414-eab6601e2ceb+33:5604:x1874687695030528:12345-192.168.201.1@tcp:35:ldlm_bl.0 Request processed in 526us (928us total) trans 4294967336 rc 0/0 00000100:00100000:0.0:1787841815.462098:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 13 00000100:00100000:1.0:1787841815.468238:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841815.468479:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695030656 00000100:00100000:2.0:1787841815.468494:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695030656 00010000:00010000:2.0:1787841815.468796:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598c00/0xe3dac0c99affe6b2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d684b expref: 33 pid: 5839 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841815.468906:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 39 00000100:00100000:2.0:1787841815.468919:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf90c0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b2767a54-6703-4908-8414-eab6601e2ceb+33:2357:x1874687695030656:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787841815.468940:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787841815.469034:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598c00/0xe3dac0c99affe6b2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d684b expref: 33 pid: 5839 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841815.469051:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598c00/0xe3dac0c99affe6b2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d684b expref: 33 pid: 5839 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841815.469079:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598c00/0xe3dac0c99affe6b2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d684b expref: 33 pid: 5839 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841815.469099:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92cbd1fc7c00) 00010000:00010000:2.0:1787841815.469105:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affe6dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841815.469117:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affe6dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841815.469125:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affe6dc lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841815.469161:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787841815.469300:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affe6dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841815.469316:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affe6dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787841815.469389:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1787841815.469395:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787841815.469443:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affe6dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841815.469458:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affe6dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841815.469468:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affe6ce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841815.469476:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affe6ce lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841815.469483:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affe6ce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841815.469490:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc149c400 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:3.0:1787841815.469495:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affe6ce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841815.469504:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affe6ce lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841815.469844:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf90c0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b2767a54-6703-4908-8414-eab6601e2ceb+32:2357:x1874687695030656:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 925us (1621us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841815.469856:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 39 00010000:00010000:3.0:1787841815.470104:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92cbd1fc7300) 00010000:00010000:3.0:1787841815.470109:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787841815.470115:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affe6ce lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841815.470136:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affe6ce lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841815.470152:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affe6d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841815.470158:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affe6d5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841815.470165:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affe6d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841815.470171:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc149d600 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:3.0:1787841815.470174:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affe6d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841815.470181:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affe6d5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841815.470190:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff92cbc89cd000) 00010000:00010000:3.0:1787841815.470194:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787841815.470197:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affe6d5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841815.470203:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affe6d5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841815.470256:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149de00/0xe3dac0c99affe6c7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6852 expref: 32 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841815.470271:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affe6dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6852 expref: 31 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841815.470285:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92cbd1fc7c00) 00010000:00010000:3.0:1787841815.470288:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787841815.470290:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc149d400, rc 0) 00000100:00100000:3.0:1787841815.470333:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf90c30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2767a54-6703-4908-8414-eab6601e2ceb+31:10381:x1874687695030272:12345-192.168.201.1@tcp:101:stat.0 Request processed in 19846us (25022us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841815.470341:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 53 00000100:00100000:1.0:1787841815.582265:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841815.584169:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695030912 00000100:00100000:3.0:1787841815.584189:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695030912 00000100:00100000:3.0:1787841815.584298:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 54 00000100:00100000:3.0:1787841815.584310:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf90c12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+31:10387:x1874687695030912:12345-192.168.201.1@tcp:36:truncate.0 00010000:00010000:3.0:1787841815.584395:0:9449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787841815.584429:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affe6dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6852 expref: 31 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841815.584458:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92cbd1fc7c00) 00010000:00010000:3.0:1787841815.584465:0:9449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787841815.585772:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598c00/0xe3dac0c99affe6e3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841815.585796:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598c00/0xe3dac0c99affe6e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841815.585808:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598c00/0xe3dac0c99affe6e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787841815.585899:0:9449:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:2.0:1787841815.585929:0:9449:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000037af789e reply state 000000008eacdb0a transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598c00/0xe3dac0c99affe6e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841815.585940:0:9449:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787841815.586116:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf90c12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+33:10387:x1874687695030912:12345-192.168.201.1@tcp:36:truncate.0 Request processed in 1806us (3874us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1787841815.586126:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 54 00000020:00080000:2.0:1787841815.586132:0:9449:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787841815.606272:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598c00/0xe3dac0c99affe6e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841815.606296:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598c00/0xe3dac0c99affe6e3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841815.606305:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598c00/0xe3dac0c99affe6e3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841815.606312:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6598c00 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:2.0:1787841815.606318:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598c00/0xe3dac0c99affe6e3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841815.606326:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598c00/0xe3dac0c99affe6e3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841815.606358:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92cbd1fc7c00) 00010000:00010000:2.0:1787841815.606361:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787841815.606368:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598c00/0xe3dac0c99affe6e3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841815.606375:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598c00/0xe3dac0c99affe6e3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841815.790413:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841815.790678:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695031040 00000100:00100000:2.0:1787841815.790692:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695031040 00000100:00100000:2.0:1787841815.790839:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 55 00000100:00100000:2.0:1787841815.790851:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf90c2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+32:10401:x1874687695031040:12345-192.168.201.1@tcp:101:stat.0 00010000:00010000:2.0:1787841815.791060:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841815.791090:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598c00/0xe3dac0c99affe6ea lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6859 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841815.791213:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599a00/0xe3dac0c99affe6f1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841815.791232:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599a00/0xe3dac0c99affe6f1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841815.791246:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599a00/0xe3dac0c99affe6f1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841815.791263:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599800/0xe3dac0c99affe6f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841815.791268:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599800/0xe3dac0c99affe6f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841815.791274:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599800/0xe3dac0c99affe6f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841815.792414:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598e00/0xe3dac0c99affe6ff lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841815.792430:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598e00/0xe3dac0c99affe6ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841815.792448:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598e00/0xe3dac0c99affe6ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787841815.792496:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:2.0:1787841815.792502:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787841815.792529:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598e00/0xe3dac0c99affe6ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841815.792609:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598e00/0xe3dac0c99affe6ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841815.792619:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599a00/0xe3dac0c99affe6f1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841815.792626:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599a00/0xe3dac0c99affe6f1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841815.792633:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599a00/0xe3dac0c99affe6f1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841815.792640:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6599a00 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:2.0:1787841815.792644:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599a00/0xe3dac0c99affe6f1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841815.792652:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599a00/0xe3dac0c99affe6f1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841815.792666:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92cbd1fc7300) 00010000:00010000:2.0:1787841815.792670:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787841815.792675:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599a00/0xe3dac0c99affe6f1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841815.792691:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599a00/0xe3dac0c99affe6f1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841815.792753:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599800/0xe3dac0c99affe6f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841815.792761:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599800/0xe3dac0c99affe6f8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841815.792767:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599800/0xe3dac0c99affe6f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841815.792772:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6599800 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:2.0:1787841815.792775:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599800/0xe3dac0c99affe6f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841815.792781:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599800/0xe3dac0c99affe6f8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841815.792789:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff92cbc3b04d00) 00010000:00010000:2.0:1787841815.792791:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787841815.792794:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599800/0xe3dac0c99affe6f8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841815.792800:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599800/0xe3dac0c99affe6f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841815.793415:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598c00/0xe3dac0c99affe6ea lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6859 expref: 34 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841815.793434:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598e00/0xe3dac0c99affe6ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6859 expref: 33 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841815.793451:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92cbd1fc7c00) 00010000:00010000:2.0:1787841815.793453:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787841815.793456:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc6598e00, rc 0) 00000100:00100000:2.0:1787841815.793889:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf90c2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+33:10401:x1874687695031040:12345-192.168.201.1@tcp:101:stat.0 Request processed in 3037us (3490us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841815.793901:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 55 00000100:00100000:0.0:1787841815.810143:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf90c03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3299:1874687714985728:0@lo:400:kworker.0 00000100:00100000:0.0:1787841815.810274:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841815.810378:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714985728 00000100:00100000:0.0:1787841815.810386:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714985728 00000100:00100000:0.0:1787841815.810447:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1787841815.810457:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:3299:x1874687714985728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841815.810520:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:3299:x1874687714985728:12345-0@lo:400:kworker.0 Request processed in 65us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841815.810528:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1787841815.810604:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf90c03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3299:1874687714985728:0@lo:400:kworker.0 00000100:00100000:1.0:1787841815.811797:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6c68780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687714986112:0@lo:400:kworker.0 00000100:00100000:1.0:1787841815.811851:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841815.812054:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787841815.812061:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6c69680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1874687714986240:0@lo:400:kworker.0 00000100:00100000:1.0:1787841815.812092:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841815.812128:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714986112 00000100:00100000:1.0:1787841815.812135:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714986112 00000100:00100000:1.0:1787841815.812205:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787841815.812214:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6c6a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1874687714986112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841815.812269:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6c6a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1874687714986112:12345-0@lo:400:kworker.0 Request processed in 56us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841815.812277:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:1.0:1787841815.812302:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787841815.812338:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6c68780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687714986112:0@lo:400:kworker.0 00000100:00100000:1.0:1787841815.812365:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714986240 00000100:00100000:1.0:1787841815.812369:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714986240 00000100:00080000:1.0:1787841815.812388:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787841815.812417:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787841815.812423:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6c68f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1874687714986240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841815.812461:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6c68f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1874687714986240:12345-0@lo:400:kworker.0 Request processed in 38us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841815.812466:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787841815.812504:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6c69680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1874687714986240:0@lo:400:kworker.0 00000100:00100000:2.0:1787841815.812927:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6c6bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1874687714985984:0@lo:400:kworker.0 00000100:00100000:2.0:1787841815.812965:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841815.812992:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787841815.812999:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6c692c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874687714985856:0@lo:400:kworker.0 00000100:00100000:2.0:1787841815.813020:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841815.813037:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6c69a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874687714986368:0@lo:400:kworker.0 00000100:00100000:2.0:1787841815.813061:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841815.813091:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714986368 00000100:00100000:2.0:1787841815.813095:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714986368 00000100:00100000:2.0:1787841815.813133:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787841815.813141:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf04c1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3301:x1874687714986368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841815.813180:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf04c1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3301:x1874687714986368:12345-0@lo:400:kworker.0 Request processed in 40us (119us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841815.813187:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787841815.813216:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6c69a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874687714986368:0@lo:400:kworker.0 00000100:00100000:2.0:1787841815.813234:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714985984 00000100:00100000:2.0:1787841815.813237:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714985984 00000100:00100000:2.0:1787841815.813265:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714985856 00000100:00100000:2.0:1787841815.813275:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714985856 00000100:00100000:2.0:1787841815.813291:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1787841815.813296:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf04c2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874687714985984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841815.813327:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf04c2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874687714985984:12345-0@lo:400:kworker.0 Request processed in 32us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841815.813333:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1787841815.813341:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787841815.813346:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf04c2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874687714985856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841815.813367:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf04c2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874687714985856:12345-0@lo:400:kworker.0 Request processed in 21us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841815.813372:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00080000:2.0:1787841815.813387:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787841815.813401:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6c692c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874687714985856:0@lo:400:kworker.0 00000100:00100000:2.0:1787841815.813411:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6c6bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1874687714985984:0@lo:400:kworker.0 00000100:00100000:0.0:1787841815.816594:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000004:00080000:3.0:1787841815.822177:0:7997:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 355820474253ns, next at 356820470811ns, rc = 0 00000100:00100000:0.0:1787841815.828769:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff40a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874687714986496:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787841815.828957:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841815.830481:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714986496 00000100:00100000:3.0:1787841815.830496:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714986496 00000100:00100000:3.0:1787841815.830618:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787841815.830631:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd7a12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1874687714986496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787841815.830691:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787841815.830833:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd7a12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1874687714986496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 204us (1875us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841815.830842:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787841815.831155:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff40a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874687714986496:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787841815.938859:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841815.938996:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695031296 00000100:00100000:2.0:1787841815.939010:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695031296 00000100:00100000:2.0:1787841815.939097:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 56 00000100:00100000:2.0:1787841815.939112:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6c69680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+33:10411:x1874687695031296:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:2.0:1787841815.939140:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841815.939165:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598c00/0xe3dac0c99affe706 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6860 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787841815.939516:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:2.0:1787841815.939778:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598c00/0xe3dac0c99affe706 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6860 expref: 35 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841815.939804:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92cbc89cd800) 00010000:00010000:2.0:1787841815.939808:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787841815.939814:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598c00/0xe3dac0c99affe706 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6860 expref: 35 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841815.939832:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc6598c00, rc 0) 00000100:00100000:2.0:1787841815.939901:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6c69680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+34:10411:x1874687695031296:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 794us (1058us total) trans 4294967339 rc 301/301 00000100:00100000:2.0:1787841815.939910:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 56 00000100:00100000:1.0:1787841815.946597:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841815.946679:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695031552 00000100:00100000:2.0:1787841815.946692:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695031552 00000100:00100000:2.0:1787841815.946798:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 14 00000100:00100000:2.0:1787841815.946808:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6c68780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b2767a54-6703-4908-8414-eab6601e2ceb+34:10411:x1874687695031552:12345-192.168.201.1@tcp:35:lfs.0 00000100:00100000:2.0:1787841815.947340:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6c68780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b2767a54-6703-4908-8414-eab6601e2ceb+35:10411:x1874687695031552:12345-192.168.201.1@tcp:35:lfs.0 Request processed in 532us (753us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1787841815.947345:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 14 00000100:00100000:0.0:1787841816.019401:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841816.019549:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695031808 00000100:00100000:2.0:1787841816.019563:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695031808 00000100:00100000:2.0:1787841816.019826:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 57 00000100:00100000:2.0:1787841816.019838:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf90c03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2767a54-6703-4908-8414-eab6601e2ceb+35:10417:x1874687695031808:12345-192.168.201.1@tcp:101:bash.0 00010000:00010000:2.0:1787841816.019870:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841816.019900:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598c00/0xe3dac0c99affe714 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6867 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.020052:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599800/0xe3dac0c99affe71b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.020088:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598e00/0xe3dac0c99affe6ff lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6859 expref: 36 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.020099:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599800/0xe3dac0c99affe71b lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.020146:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598e00/0xe3dac0c99affe6ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6859 expref: 36 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.020161:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598e00/0xe3dac0c99affe6ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6859 expref: 36 pid: 5839 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841816.020177:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4bac000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5838:1874687714986624:192.168.201.1@tcp:104: 00000100:00100000:2.0:1787841816.020306:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbf0518b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787841816.026768:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841816.026942:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4bac000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5838:1874687714986624:192.168.201.1@tcp:104: 00010000:00010000:2.0:1787841816.026982:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599800/0xe3dac0c99affe71b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841816.027469:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695031936 00000100:00100000:0.0:1787841816.027480:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695031936 00010000:00010000:0.0:1787841816.027533:0:7632:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598e00/0xe3dac0c99affe6ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6859 expref: 37 pid: 5839 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841816.029191:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 40 00000100:00100000:0.0:1787841816.029217:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6c6b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b2767a54-6703-4908-8414-eab6601e2ceb+37:2357:x1874687695031936:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787841816.029258:0:7632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787841816.029270:0:7632:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598e00/0xe3dac0c99affe6ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6859 expref: 37 pid: 5839 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841816.029288:0:7632:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598e00/0xe3dac0c99affe6ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6859 expref: 37 pid: 5839 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841816.029348:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598e00/0xe3dac0c99affe6ff lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6859 expref: 37 pid: 5839 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841816.029370:0:7632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92cbd1fc7c00) 00010000:00010000:0.0:1787841816.029377:0:7632:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599800/0xe3dac0c99affe71b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841816.029388:0:7632:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599800/0xe3dac0c99affe71b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841816.029397:0:7632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599800/0xe3dac0c99affe71b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841816.029437:0:7632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787841816.029487:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599800/0xe3dac0c99affe71b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.029496:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599800/0xe3dac0c99affe71b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787841816.029518:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000100:00100000:0.0:1787841816.029530:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6c6b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b2767a54-6703-4908-8414-eab6601e2ceb+36:2357:x1874687695031936:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 327us (2780us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841816.029540:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 40 00010000:00010000:2.0:1787841816.029732:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598c00/0xe3dac0c99affe714 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6867 expref: 37 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.029775:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599800/0xe3dac0c99affe71b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6867 expref: 36 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.029781:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92cbd1fc7c00) 00010000:00010000:2.0:1787841816.029783:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787841816.029785:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc6599800, rc 0) 00000100:00100000:2.0:1787841816.029809:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf90c03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2767a54-6703-4908-8414-eab6601e2ceb+36:10417:x1874687695031808:12345-192.168.201.1@tcp:101:bash.0 Request processed in 9976us (10427us total) trans 4294967341 rc 0/0 00000100:00100000:2.0:1787841816.029815:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 57 00000100:00100000:2.0:1787841816.035554:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841816.035653:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695032192 00000100:00100000:0.0:1787841816.035667:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695032192 00000100:00100000:0.0:1787841816.035814:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 58 00000100:00100000:0.0:1787841816.035827:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbd4bac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+36:10417:x1874687695032192:12345-192.168.201.1@tcp:36:bash.0 00010000:00010000:0.0:1787841816.036225:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a800/0xe3dac0c99affe729 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841816.036248:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a800/0xe3dac0c99affe729 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841816.036264:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a800/0xe3dac0c99affe729 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787841816.036350:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:0.0:1787841816.036378:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f58a30c0 reply state 00000000bbebbc59 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a800/0xe3dac0c99affe729 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841816.036389:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787841816.036510:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbd4bac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+39:10417:x1874687695032192:12345-192.168.201.1@tcp:36:bash.0 Request processed in 686us (972us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1787841816.036519:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 58 00000020:00080000:0.0:1787841816.036525:0:5839:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787841816.043306:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a800/0xe3dac0c99affe729 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841816.043333:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a800/0xe3dac0c99affe729 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841816.043344:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a800/0xe3dac0c99affe729 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841816.043352:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbffa3a800 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:3.0:1787841816.043367:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a800/0xe3dac0c99affe729 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841816.043377:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a800/0xe3dac0c99affe729 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841816.043400:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92cbd1fc7c00) 00010000:00010000:3.0:1787841816.043404:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787841816.043411:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a800/0xe3dac0c99affe729 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841816.043419:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a800/0xe3dac0c99affe729 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841816.046690:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841816.046961:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695032320 00000100:00100000:1.0:1787841816.046975:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695032320 00000100:00100000:1.0:1787841816.047049:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 59 00000100:00100000:1.0:1787841816.047062:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e65e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+38:10417:x1874687695032320:12345-192.168.201.1@tcp:101:bash.0 00010000:00010000:1.0:1787841816.047097:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841816.047124:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99affe730 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d686e expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841816.047307:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c600/0xe3dac0c99affe737 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841816.047325:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599800/0xe3dac0c99affe71b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6867 expref: 39 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841816.047335:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c600/0xe3dac0c99affe737 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841816.050431:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599800/0xe3dac0c99affe71b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6867 expref: 39 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841816.050471:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599800/0xe3dac0c99affe71b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6867 expref: 39 pid: 5838 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841816.050495:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6c6b840 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1874687714986752:192.168.201.1@tcp:104: 00000100:00100000:1.0:1787841816.050664:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cac3324000 going to sleep for 11 seconds 00000100:00100000:2.0:1787841816.055329:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6c6b840 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1874687714986752:192.168.201.1@tcp:104: 00010000:00010000:2.0:1787841816.055373:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c600/0xe3dac0c99affe737 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841816.055655:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841816.055749:0:7633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695032448 00000100:00100000:0.0:1787841816.055757:0:7633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695032448 00010000:00010000:0.0:1787841816.055800:0:7633:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599800/0xe3dac0c99affe71b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6867 expref: 40 pid: 5838 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841816.055839:0:7633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 41 00000100:00100000:0.0:1787841816.055845:0:7633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6c69e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b2767a54-6703-4908-8414-eab6601e2ceb+40:2356:x1874687695032448:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787841816.055861:0:7633:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787841816.055867:0:7633:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599800/0xe3dac0c99affe71b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6867 expref: 40 pid: 5838 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841816.055885:0:7633:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599800/0xe3dac0c99affe71b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6867 expref: 40 pid: 5838 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841816.055908:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599800/0xe3dac0c99affe71b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6867 expref: 40 pid: 5838 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841816.055925:0:7633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92cbd1fc7c00) 00010000:00010000:0.0:1787841816.055945:0:7633:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c600/0xe3dac0c99affe737 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841816.055954:0:7633:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c600/0xe3dac0c99affe737 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841816.055968:0:7633:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c600/0xe3dac0c99affe737 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841816.055994:0:7633:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787841816.056054:0:7633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6c69e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b2767a54-6703-4908-8414-eab6601e2ceb+39:2356:x1874687695032448:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 209us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841816.056059:0:7633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 41 00010000:00010000:1.0:1787841816.056584:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c600/0xe3dac0c99affe737 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841816.056593:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c600/0xe3dac0c99affe737 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787841816.056658:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1787841816.056664:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787841816.056690:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c600/0xe3dac0c99affe737 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841816.056791:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99affe730 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d686e expref: 39 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841816.056820:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c600/0xe3dac0c99affe737 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d686e expref: 38 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841816.056831:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92cbd1fc7c00) 00010000:00010000:1.0:1787841816.056834:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787841816.056837:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cc00d9c600, rc 0) 00000100:00100000:0.0:1787841816.056954:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e65e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+38:10417:x1874687695032320:12345-192.168.201.1@tcp:101:bash.0 Request processed in 9895us (10279us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841816.057008:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 59 00000100:00100000:1.0:1787841816.064848:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841816.064947:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695032704 00000100:00100000:2.0:1787841816.064961:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695032704 00000100:00100000:2.0:1787841816.065044:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 15 00000100:00100000:2.0:1787841816.065058:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbc6c31c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b2767a54-6703-4908-8414-eab6601e2ceb+38:10417:x1874687695032704:12345-192.168.201.1@tcp:35:bash.0 00000100:00100000:2.0:1787841816.065410:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbc6c31c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b2767a54-6703-4908-8414-eab6601e2ceb+39:10417:x1874687695032704:12345-192.168.201.1@tcp:35:bash.0 Request processed in 353us (575us total) trans 4294967344 rc 0/0 00000100:00100000:2.0:1787841816.065419:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 15 00010000:00010000:2.0:1787841816.130906:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787841816.180658:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841816.181113:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695032960 00000100:00100000:2.0:1787841816.181131:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695032960 00000100:00100000:2.0:1787841816.181293:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 60 00000100:00100000:2.0:1787841816.181306:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6c68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+39:10427:x1874687695032960:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:2.0:1787841816.181342:0:9449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841816.181371:0:9449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599a00/0xe3dac0c99affe73e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6875 expref: -99 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787841816.181767:0:9449:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:2.0:1787841816.182206:0:9449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599a00/0xe3dac0c99affe73e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6875 expref: 41 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.182226:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92cbc89cd800) 00010000:00010000:2.0:1787841816.182230:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787841816.182236:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599a00/0xe3dac0c99affe73e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6875 expref: 41 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.182254:0:9449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc6599a00, rc 0) 00000100:00100000:2.0:1787841816.182363:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6c68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+40:10427:x1874687695032960:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 1060us (1723us total) trans 4294967345 rc 301/301 00000100:00100000:2.0:1787841816.182373:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 60 00000100:00100000:2.0:1787841816.185283:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841816.185371:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695033088 00000100:00100000:3.0:1787841816.185383:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695033088 00000100:00100000:3.0:1787841816.185596:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 61 00000100:00100000:3.0:1787841816.185610:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd7a1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2767a54-6703-4908-8414-eab6601e2ceb+40:10427:x1874687695033088:12345-192.168.201.1@tcp:34:lfs.0 00010000:00010000:3.0:1787841816.185964:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affe74c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841816.185987:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affe74c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841816.186020:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affe74c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841816.186039:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149de00/0xe3dac0c99affe753 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841816.186047:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149de00/0xe3dac0c99affe753 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841816.186054:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149de00/0xe3dac0c99affe753 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841816.186367:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affe75a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841816.186376:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affe75a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841816.186384:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affe75a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787841816.186503:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affe75a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841816.186573:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affe74c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841816.186581:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affe74c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841816.186589:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affe74c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841816.186606:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc149d400 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:3.0:1787841816.186611:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affe74c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841816.186620:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affe74c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841816.186635:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92cbd1fc7300) 00010000:00010000:3.0:1787841816.186638:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787841816.186644:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affe74c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841816.186650:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affe74c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841816.186666:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149de00/0xe3dac0c99affe753 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841816.186672:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149de00/0xe3dac0c99affe753 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841816.186679:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149de00/0xe3dac0c99affe753 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841816.186684:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc149de00 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:3.0:1787841816.186687:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149de00/0xe3dac0c99affe753 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841816.186693:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149de00/0xe3dac0c99affe753 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841816.187028:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff92cbc89cdb00) 00010000:00010000:3.0:1787841816.187031:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787841816.187035:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149de00/0xe3dac0c99affe753 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841816.187042:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149de00/0xe3dac0c99affe753 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841816.187059:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affe75a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841816.187065:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affe75a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841816.187071:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affe75a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841816.187077:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc149d600 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:3.0:1787841816.187080:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affe75a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841816.187086:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affe75a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841816.187092:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92cbd1fc7c00) 00010000:00010000:3.0:1787841816.187094:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787841816.187097:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affe75a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841816.187103:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affe75a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841816.187268:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd7a1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2767a54-6703-4908-8414-eab6601e2ceb+40:10427:x1874687695033088:12345-192.168.201.1@tcp:34:lfs.0 Request processed in 1658us (1994us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841816.187279:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 61 00000100:00100000:1.0:1787841816.196093:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841816.196433:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695033344 00000100:00100000:2.0:1787841816.196573:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695033344 00000100:00100000:2.0:1787841816.196694:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 16 00000100:00100000:2.0:1787841816.196835:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6c6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b2767a54-6703-4908-8414-eab6601e2ceb+40:10427:x1874687695033344:12345-192.168.201.1@tcp:35:lfs.0 00000100:00100000:2.0:1787841816.197689:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6c6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b2767a54-6703-4908-8414-eab6601e2ceb+41:10427:x1874687695033344:12345-192.168.201.1@tcp:35:lfs.0 Request processed in 856us (1622us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1787841816.197731:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 16 00000100:00100000:1.0:1787841816.253531:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841816.253770:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695033600 00000100:00100000:0.0:1787841816.253785:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695033600 00000100:00100000:0.0:1787841816.254040:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 62 00000100:00100000:0.0:1787841816.254053:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6c6a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+41:10430:x1874687695033600:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:0.0:1787841816.254091:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841816.254120:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a200/0xe3dac0c99affe761 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d687c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841816.254237:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3ae00/0xe3dac0c99affe768 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841816.254258:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3ae00/0xe3dac0c99affe768 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841816.254299:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3ae00/0xe3dac0c99affe768 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841816.254319:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a800/0xe3dac0c99affe76f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841816.254327:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a800/0xe3dac0c99affe76f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841816.254334:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a800/0xe3dac0c99affe76f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841816.254788:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a600/0xe3dac0c99affe776 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841816.254798:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a600/0xe3dac0c99affe776 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841816.254806:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a600/0xe3dac0c99affe776 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787841816.254826:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787841816.254949:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3ae00/0xe3dac0c99affe768 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841816.254957:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3ae00/0xe3dac0c99affe768 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841816.254964:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3ae00/0xe3dac0c99affe768 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841816.254971:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbffa3ae00 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:0.0:1787841816.254985:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3ae00/0xe3dac0c99affe768 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841816.254995:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3ae00/0xe3dac0c99affe768 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841816.255012:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92cbd1fc7300) 00010000:00010000:0.0:1787841816.255015:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841816.255021:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3ae00/0xe3dac0c99affe768 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841816.255029:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3ae00/0xe3dac0c99affe768 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841816.255045:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a800/0xe3dac0c99affe76f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841816.255051:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a800/0xe3dac0c99affe76f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841816.255057:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a800/0xe3dac0c99affe76f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841816.255062:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbffa3a800 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:0.0:1787841816.255065:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a800/0xe3dac0c99affe76f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841816.255071:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a800/0xe3dac0c99affe76f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841816.255079:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff92cbc57e3100) 00010000:00010000:0.0:1787841816.255081:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841816.255090:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a800/0xe3dac0c99affe76f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841816.255096:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a800/0xe3dac0c99affe76f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841816.255152:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a200/0xe3dac0c99affe761 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d687c expref: 44 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841816.255166:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a600/0xe3dac0c99affe776 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d687c expref: 43 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841816.255174:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92cbd1fc7c00) 00010000:00010000:0.0:1787841816.255176:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787841816.255178:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbffa3a600, rc 0) 00000100:00100000:0.0:1787841816.255271:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6c6a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+43:10430:x1874687695033600:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 1221us (1762us total) trans 4294967347 rc 0/0 00000100:00100000:0.0:1787841816.255279:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 62 00000100:00100000:3.0:1787841816.259104:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841816.259164:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841816.259290:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695033728 00000100:00100000:1.0:1787841816.259307:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695033728 00000100:00100000:1.0:1787841816.259413:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 4 00000100:00100000:1.0:1787841816.259425:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff40b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b2767a54-6703-4908-8414-eab6601e2ceb+43:2357:x1874687695033728:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787841816.259475:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787841816.259509:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a600/0xe3dac0c99affe776 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d687c expref: 43 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841816.259534:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92cbd1fc7c00) 00010000:00010000:1.0:1787841816.259539:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787841816.259617:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff40b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b2767a54-6703-4908-8414-eab6601e2ceb+42:2357:x1874687695033728:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 194us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841816.259625:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 4 00000100:00100000:0.0:1787841816.260049:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695033856 00000100:00100000:0.0:1787841816.260144:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695033856 00000100:00100000:0.0:1787841816.260183:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 63 00000100:00100000:0.0:1787841816.260192:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff4092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+42:10430:x1874687695033856:12345-192.168.201.1@tcp:54:lfs.0 00010000:00010000:0.0:1787841816.260269:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99affe784 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841816.260284:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99affe784 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841816.260292:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99affe784 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841816.261096:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99affe784 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841816.261105:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99affe784 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841816.261110:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99affe784 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841816.261114:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbffa3be00 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:0.0:1787841816.261118:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99affe784 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841816.261125:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99affe784 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841816.261134:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92cbd1fc7c00) 00010000:00010000:0.0:1787841816.261136:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787841816.261140:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99affe784 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841816.261144:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99affe784 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841816.261206:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff4092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+42:10430:x1874687695033856:12345-192.168.201.1@tcp:54:lfs.0 Request processed in 1013us (2119us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841816.261213:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 63 00000100:00100000:3.0:1787841816.266024:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841816.266168:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695034112 00000100:00100000:1.0:1787841816.266182:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695034112 00000100:00100000:1.0:1787841816.266252:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 17 00000100:00100000:1.0:1787841816.266264:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff40a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b2767a54-6703-4908-8414-eab6601e2ceb+42:10430:x1874687695034112:12345-192.168.201.1@tcp:35:lfs.0 00000100:00100000:1.0:1787841816.266588:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff40a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b2767a54-6703-4908-8414-eab6601e2ceb+43:10430:x1874687695034112:12345-192.168.201.1@tcp:35:lfs.0 Request processed in 318us (576us total) trans 4294967348 rc 0/0 00000100:00100000:1.0:1787841816.266596:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 17 00000100:00100000:1.0:1787841816.399857:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841816.400745:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695034368 00000100:00100000:2.0:1787841816.400761:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695034368 00000100:00100000:2.0:1787841816.400906:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 64 00000100:00100000:2.0:1787841816.400919:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6c68b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+43:10448:x1874687695034368:12345-192.168.201.1@tcp:101:cat.0 00010000:00010000:2.0:1787841816.401187:0:9449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841816.401218:0:9449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599a00/0xe3dac0c99affe78b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6883 expref: -99 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.401363:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598200/0xe3dac0c99affe792 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.401383:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598200/0xe3dac0c99affe792 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.401399:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598200/0xe3dac0c99affe792 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787841816.401415:0:9449:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1787841816.401895:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599a00/0xe3dac0c99affe78b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6883 expref: 46 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.402188:0:9449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598200/0xe3dac0c99affe792 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6883 expref: 45 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.402200:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92cbd1fc7c00) 00010000:00010000:2.0:1787841816.402204:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787841816.402209:0:9449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc6598200, rc 0) 00000100:00100000:2.0:1787841816.402308:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6c68b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+45:10448:x1874687695034368:12345-192.168.201.1@tcp:101:cat.0 Request processed in 1392us (2471us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1787841816.402340:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 64 00000100:00100000:3.0:1787841816.440905:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841816.448223:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695034496 00000100:00100000:2.0:1787841816.448250:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695034496 00000100:00100000:2.0:1787841816.448466:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 65 00000100:00100000:2.0:1787841816.448480:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff40a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2767a54-6703-4908-8414-eab6601e2ceb+45:10449:x1874687695034496:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:2.0:1787841816.448525:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841816.448556:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599a00/0xe3dac0c99affe7a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d688a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.448674:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599800/0xe3dac0c99affe7a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.448694:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599800/0xe3dac0c99affe7a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.448727:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599800/0xe3dac0c99affe7a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787841816.449060:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:2.0:1787841816.449067:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787841816.449156:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599800/0xe3dac0c99affe7a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.449195:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599a00/0xe3dac0c99affe7a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d688a expref: 47 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.449220:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599800/0xe3dac0c99affe7a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d688a expref: 46 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.449245:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92cbd1fc7300) 00010000:00010000:2.0:1787841816.449249:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787841816.449253:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc6599800, rc 0) 00000100:00100000:2.0:1787841816.449365:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff40a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2767a54-6703-4908-8414-eab6601e2ceb+46:10449:x1874687695034496:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 888us (8475us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841816.449376:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 65 00000100:00100000:3.0:1787841816.474521:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841816.474756:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695034880 00000100:00100000:2.0:1787841816.474770:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695034880 00000100:00100000:2.0:1787841816.474858:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 18 00000100:00100000:2.0:1787841816.474870:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd44a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b2767a54-6703-4908-8414-eab6601e2ceb+46:10449:x1874687695034880:12345-192.168.201.1@tcp:35:lfs.0 00000100:00100000:2.0:1787841816.475383:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd44a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b2767a54-6703-4908-8414-eab6601e2ceb+47:10449:x1874687695034880:12345-192.168.201.1@tcp:35:lfs.0 Request processed in 513us (880us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1787841816.475392:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 18 00000100:00100000:1.0:1787841816.484670:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841816.485017:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695035008 00000100:00100000:0.0:1787841816.485031:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695035008 00000100:00100000:0.0:1787841816.485139:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 5 00000100:00100000:0.0:1787841816.485169:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6c6a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b2767a54-6703-4908-8414-eab6601e2ceb+47:10449:x1874687695035008:12345-192.168.201.1@tcp:103:lfs.0 00010000:00010000:0.0:1787841816.485200:0:7632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787841816.485236:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c600/0xe3dac0c99affe737 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d686e expref: 47 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841816.485266:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598200/0xe3dac0c99affe792 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6883 expref: 46 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841816.485306:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d800/0xe3dac0c99affe642 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d682f expref: 45 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841816.485320:0:7632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92cbd1fc7c00) 00010000:00010000:0.0:1787841816.485332:0:7632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787841816.485406:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6c6a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b2767a54-6703-4908-8414-eab6601e2ceb+44:10449:x1874687695035008:12345-192.168.201.1@tcp:103:lfs.0 Request processed in 240us (754us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841816.485415:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 5 00000100:00100000:1.0:1787841816.489040:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841816.489197:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695035136 00000100:00100000:0.0:1787841816.489210:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695035136 00000100:00100000:0.0:1787841816.489282:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 66 00000100:00100000:0.0:1787841816.489294:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6c683c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+44:10449:x1874687695035136:12345-192.168.201.1@tcp:58:lfs.0 00010000:00010000:0.0:1787841816.489527:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99affe7ae lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841816.489549:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99affe7ae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841816.489565:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99affe7ae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787841816.495221:0:5839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787841816.495517:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:0.0:1787841816.495605:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:0.0:1787841816.495823:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6c683c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+44:10449:x1874687695035136:12345-192.168.201.1@tcp:58:lfs.0 Request processed in 6521us (6787us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841816.495839:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 66 00000100:00100000:3.0:1787841816.553485:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841816.554475:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695035264 00000100:00100000:0.0:1787841816.554489:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695035264 00000100:00100000:0.0:1787841816.554563:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 67 00000100:00100000:0.0:1787841816.554666:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd44bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+44:10451:x1874687695035264:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:0.0:1787841816.554743:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841816.554771:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a200/0xe3dac0c99affe7b5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6891 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841816.555448:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affe7bc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841816.555468:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affe7bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841816.555482:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affe7bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841816.555503:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affe7c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841816.555510:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affe7c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841816.555517:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affe7c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841816.556773:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149de00/0xe3dac0c99affe7ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841816.556804:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149de00/0xe3dac0c99affe7ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841816.556818:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149de00/0xe3dac0c99affe7ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787841816.556877:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1787841816.556883:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787841816.556909:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149de00/0xe3dac0c99affe7ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841816.556925:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149de00/0xe3dac0c99affe7ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841816.556937:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affe7bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841816.556945:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affe7bc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841816.556954:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affe7bc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841816.556962:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc149c400 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:3.0:1787841816.556967:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affe7bc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841816.556977:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affe7bc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841816.558162:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92cbd1fc7300) 00010000:00010000:3.0:1787841816.558168:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787841816.558196:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affe7bc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841816.558205:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affe7bc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841816.558228:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affe7c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841816.558236:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affe7c3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841816.558243:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affe7c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841816.558249:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc149d600 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:3.0:1787841816.558253:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affe7c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841816.558260:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affe7c3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841816.558269:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff92cbc89cdb00) 00010000:00010000:3.0:1787841816.558272:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787841816.558276:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affe7c3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841816.558281:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affe7c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841816.559150:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a200/0xe3dac0c99affe7b5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6891 expref: 46 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841816.559201:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149de00/0xe3dac0c99affe7ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6891 expref: 45 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841816.559210:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92cbc57e3100) 00010000:00010000:3.0:1787841816.559213:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787841816.559217:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc149de00, rc 0) 00000100:00100000:3.0:1787841816.559316:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd44bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+45:10451:x1874687695035264:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 4743us (5843us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841816.559327:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 67 00000040:00080000:1.0:1787841816.577131:0:11682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787841816.577144:0:11682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787841816.577217:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1787841816.577225:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787841816.577969:0:11682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6c6ad00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11682:1874687714986880:192.168.201.1@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787841816.578917:0:11682:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cac3324900 going to sleep for 11 seconds 00000100:00100000:1.0:1787841816.586816:0:11682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6c6ad00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11682:1874687714986880:192.168.201.1@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787841816.587744:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841816.587878:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695035392 00000100:00100000:3.0:1787841816.587889:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695035392 00000100:00100000:3.0:1787841816.587952:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 1 00000100:00100000:3.0:1787841816.587965:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6c6ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:b2767a54-6703-4908-8414-eab6601e2ceb+45:10453:x1874687695035392:12345-192.168.201.1@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1787841816.588094:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6c6ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:b2767a54-6703-4908-8414-eab6601e2ceb+45:10453:x1874687695035392:12345-192.168.201.1@tcp:900:lhsmtool_posix.0 Request processed in 131us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841816.588102:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 1 00000100:00100000:3.0:1787841816.599290:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841816.599383:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695035520 00000100:00100000:2.0:1787841816.599396:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695035520 00000100:00100000:2.0:1787841816.599487:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 68 00000100:00100000:2.0:1787841816.599499:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd44a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+45:10453:x1874687695035520:12345-192.168.201.1@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787841816.599548:0:9449:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787841816.599755:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd44a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+45:10453:x1874687695035520:12345-192.168.201.1@tcp:53:lhsmtool_posix.0 Request processed in 258us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841816.599765:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 68 00000100:00100000:1.0:1787841816.632510:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841816.632885:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695035648 00000100:00100000:2.0:1787841816.632899:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695035648 00000100:00100000:2.0:1787841816.632991:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 69 00000100:00100000:2.0:1787841816.633005:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6c68780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2767a54-6703-4908-8414-eab6601e2ceb+45:10453:x1874687695035648:12345-192.168.201.1@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787841816.633162:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599a00/0xe3dac0c99affe7d1 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.633187:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599a00/0xe3dac0c99affe7d1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.633205:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599a00/0xe3dac0c99affe7d1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.639119:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598c00/0xe3dac0c99affe7d8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.639146:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598c00/0xe3dac0c99affe7d8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.639160:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598c00/0xe3dac0c99affe7d8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.639198:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598e00/0xe3dac0c99affe7df lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.639208:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598e00/0xe3dac0c99affe7df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.639290:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598e00/0xe3dac0c99affe7df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787841816.639469:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1787841816.639474:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787841816.639494:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598e00/0xe3dac0c99affe7df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.639507:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599a00/0xe3dac0c99affe7d1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.639527:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599a00/0xe3dac0c99affe7d1 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.639535:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599a00/0xe3dac0c99affe7d1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.639541:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6599a00 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:2.0:1787841816.639545:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599a00/0xe3dac0c99affe7d1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.639554:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599a00/0xe3dac0c99affe7d1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.639568:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff92cbc57e3b00) 00010000:00010000:2.0:1787841816.639571:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787841816.639576:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599a00/0xe3dac0c99affe7d1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.639582:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599a00/0xe3dac0c99affe7d1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.639841:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598c00/0xe3dac0c99affe7d8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.639849:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598c00/0xe3dac0c99affe7d8 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.639855:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598c00/0xe3dac0c99affe7d8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.639860:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6598c00 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:2.0:1787841816.639870:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598c00/0xe3dac0c99affe7d8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.639878:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598c00/0xe3dac0c99affe7d8 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.639887:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff92cbc3b04800) 00010000:00010000:2.0:1787841816.639889:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787841816.639892:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598c00/0xe3dac0c99affe7d8 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.639898:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598c00/0xe3dac0c99affe7d8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.639915:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598e00/0xe3dac0c99affe7df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.639921:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598e00/0xe3dac0c99affe7df lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.639927:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598e00/0xe3dac0c99affe7df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.639932:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6598e00 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:2.0:1787841816.639935:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598e00/0xe3dac0c99affe7df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.639942:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598e00/0xe3dac0c99affe7df lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.639948:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92cbc57e3100) 00010000:00010000:2.0:1787841816.639950:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787841816.639959:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598e00/0xe3dac0c99affe7df lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.639965:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598e00/0xe3dac0c99affe7df lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841816.640574:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6c68780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2767a54-6703-4908-8414-eab6601e2ceb+45:10453:x1874687695035648:12345-192.168.201.1@tcp:34:lhsmtool_posix.0 Request processed in 7565us (8077us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841816.640587:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 69 00000100:00100000:1.0:1787841816.646123:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841816.646345:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695035904 00000100:00100000:2.0:1787841816.646363:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695035904 00000100:00100000:2.0:1787841816.646456:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 70 00000100:00100000:2.0:1787841816.646467:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6c6b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+45:10453:x1874687695035904:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787841816.646489:0:9449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841816.646512:0:9449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598e00/0xe3dac0c99affe7e6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6898 expref: -99 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.646641:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598c00/0xe3dac0c99affe7ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.646657:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598c00/0xe3dac0c99affe7ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.646668:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598c00/0xe3dac0c99affe7ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787841816.646680:0:9449:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1787841816.646840:0:9449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598c00/0xe3dac0c99affe7ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.646848:0:9449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598c00/0xe3dac0c99affe7ed lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.646870:0:9449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598c00/0xe3dac0c99affe7ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.646876:0:9449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6598c00 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:2.0:1787841816.646880:0:9449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598c00/0xe3dac0c99affe7ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.646888:0:9449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598c00/0xe3dac0c99affe7ed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.646907:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92cbc57e3100) 00010000:00010000:2.0:1787841816.646910:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787841816.646915:0:9449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598c00/0xe3dac0c99affe7ed lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.646922:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598c00/0xe3dac0c99affe7ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.646965:0:9449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598e00/0xe3dac0c99affe7e6 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6898 expref: 47 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.646974:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff92cbc57e3b00) 00010000:00010000:2.0:1787841816.646976:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787841816.646980:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598e00/0xe3dac0c99affe7e6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6898 expref: 47 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.646989:0:9449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc6598e00, rc 0) 00000100:00100000:2.0:1787841816.647060:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6c6b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+46:10453:x1874687695035904:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 Request processed in 595us (953us total) trans 4294967351 rc 301/301 00000100:00100000:2.0:1787841816.647077:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 70 00000100:00100000:3.0:1787841816.658161:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841816.659251:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695036032 00000100:00100000:2.0:1787841816.659266:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695036032 00000100:00100000:2.0:1787841816.659344:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 71 00000100:00100000:2.0:1787841816.659354:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd44b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+46:10453:x1874687695036032:12345-192.168.201.1@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787841816.659400:0:5837:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787841816.659536:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd44b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+46:10453:x1874687695036032:12345-192.168.201.1@tcp:53:lhsmtool_posix.0 Request processed in 183us (1385us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841816.659544:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 71 00000100:00100000:1.0:1787841816.666670:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841816.668479:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695036288 00000100:00100000:2.0:1787841816.668497:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695036288 00000100:00100000:2.0:1787841816.668563:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 72 00000100:00100000:2.0:1787841816.668574:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6c6bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+46:10453:x1874687695036288:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787841816.668601:0:9449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841816.668606:0:9449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787841816.668635:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599800/0xe3dac0c99affe7a7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d688a expref: 46 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.668655:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92cbd1fc7300) 00010000:00010000:2.0:1787841816.668660:0:9449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787841816.668674:0:9449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598e00/0xe3dac0c99affe7fb lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d689f expref: -99 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787841816.669513:0:9449:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:0.0:1787841816.669664:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3ae00/0xe3dac0c99affe802 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841816.669676:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3ae00/0xe3dac0c99affe802 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841816.669684:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3ae00/0xe3dac0c99affe802 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841816.669772:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598e00/0xe3dac0c99affe7fb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d689f expref: 48 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841816.669788:0:9449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3ae00/0xe3dac0c99affe802 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d689f expref: 47 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841816.669803:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff92cbc57e3800) 00010000:00010000:0.0:1787841816.669806:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787841816.669809:0:9449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbffa3ae00, rc 0) 00000100:00100000:0.0:1787841816.669874:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6c6bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+47:10453:x1874687695036288:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 Request processed in 1302us (3214us total) trans 4294967352 rc 0/0 00000100:00100000:0.0:1787841816.669882:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 72 00000100:00100000:1.0:1787841816.679015:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841816.679369:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695036544 00000100:00100000:2.0:1787841816.679395:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695036544 00000100:00100000:2.0:1787841816.679476:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 73 00000100:00100000:2.0:1787841816.679508:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6c692c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+47:10453:x1874687695036544:12345-192.168.201.1@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787841816.679584:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787841816.679636:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3ae00/0xe3dac0c99affe802 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d689f expref: 47 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.679660:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff92cbc57e3800) 00010000:00010000:2.0:1787841816.679673:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787841816.679995:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599800/0xe3dac0c99affe810 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.680011:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599800/0xe3dac0c99affe810 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.680022:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599800/0xe3dac0c99affe810 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.680038:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599a00/0xe3dac0c99affe817 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x108ce496 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.680045:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599a00/0xe3dac0c99affe817 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x108ce496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.680052:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599a00/0xe3dac0c99affe817 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x108ce496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.680328:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599800/0xe3dac0c99affe810 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.680337:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599800/0xe3dac0c99affe810 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.680354:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599800/0xe3dac0c99affe810 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.680360:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6599800 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:2.0:1787841816.680365:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599800/0xe3dac0c99affe810 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.681272:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599800/0xe3dac0c99affe810 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.681298:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92cbd1fc7300) 00010000:00010000:2.0:1787841816.681644:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787841816.681652:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599800/0xe3dac0c99affe810 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.681660:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599800/0xe3dac0c99affe810 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.681681:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599a00/0xe3dac0c99affe817 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x108ce496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.681687:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599a00/0xe3dac0c99affe817 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x108ce496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.681695:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599a00/0xe3dac0c99affe817 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x108ce496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.682561:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6599a00 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:2.0:1787841816.682566:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599a00/0xe3dac0c99affe817 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x108ce496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.682660:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599a00/0xe3dac0c99affe817 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x108ce496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.682679:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x108ce496 (ffff92cbc3b04800) 00010000:00010000:2.0:1787841816.682682:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787841816.682687:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599a00/0xe3dac0c99affe817 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x108ce496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.682694:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599a00/0xe3dac0c99affe817 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x108ce496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841816.682956:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6c692c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+46:10453:x1874687695036544:12345-192.168.201.1@tcp:36:lhsmtool_posix.0 Request processed in 3444us (3947us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787841816.682966:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 73 00000100:00100000:2.0:1787841816.693131:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841816.693235:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695036672 00000100:00100000:0.0:1787841816.693247:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695036672 00000100:00100000:0.0:1787841816.693320:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 74 00000100:00100000:0.0:1787841816.693332:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd7a2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+46:10453:x1874687695036672:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787841816.693353:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841816.693390:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b400/0xe3dac0c99affe81e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d68a6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841816.693436:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a000/0xe3dac0c99affe825 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841816.693449:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a000/0xe3dac0c99affe825 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841816.693461:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a000/0xe3dac0c99affe825 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841816.694056:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b400/0xe3dac0c99affe81e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d68a6 expref: 48 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841816.694078:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a000/0xe3dac0c99affe825 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d68a6 expref: 47 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841816.694096:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff92cbc57e3a00) 00010000:00010000:0.0:1787841816.694099:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787841816.694103:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbffa3a000, rc 0) 00000100:00100000:0.0:1787841816.694160:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd7a2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+47:10453:x1874687695036672:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 Request processed in 830us (1039us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841816.694167:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 74 00000100:00100000:3.0:1787841816.705477:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841816.705515:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695036928 00000100:00100000:3.0:1787841816.705539:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695036928 00000100:00100000:0.0:1787841816.706022:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 75 00000100:00100000:0.0:1787841816.706036:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd448780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2767a54-6703-4908-8414-eab6601e2ceb+47:10453:x1874687695036928:12345-192.168.201.1@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787841816.706154:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b200/0xe3dac0c99affe82c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841816.706175:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b200/0xe3dac0c99affe82c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841816.706189:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b200/0xe3dac0c99affe82c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787841816.706935:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:0.0:1787841816.706949:0:5838:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 356705250193ns, next at 357705247808ns, rc = 0 00000004:00010000:0.0:1787841816.707049:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000164e5df7 reply state 0000000088bfdeee transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b200/0xe3dac0c99affe82c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841816.707059:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787841816.707169:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd448780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2767a54-6703-4908-8414-eab6601e2ceb+49:10453:x1874687695036928:12345-192.168.201.1@tcp:36:lhsmtool_posix.0 Request processed in 1135us (1702us total) trans 4294967353 rc 0/0 00000100:00100000:0.0:1787841816.707178:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 75 00000100:00100000:3.0:1787841816.712837:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00010000:00010000:2.0:1787841816.712989:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b200/0xe3dac0c99affe82c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.713003:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b200/0xe3dac0c99affe82c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.713011:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b200/0xe3dac0c99affe82c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.713017:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbffa3b200 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:2.0:1787841816.713022:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b200/0xe3dac0c99affe82c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.713030:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b200/0xe3dac0c99affe82c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.713069:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff92cbc57e3a00) 00010000:00010000:2.0:1787841816.713072:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787841816.713078:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b200/0xe3dac0c99affe82c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841816.713084:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b200/0xe3dac0c99affe82c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841816.714821:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695037056 00000100:00100000:0.0:1787841816.714855:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695037056 00000100:00100000:0.0:1787841816.714929:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 76 00000100:00100000:0.0:1787841816.714939:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd449a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+48:10453:x1874687695037056:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787841816.714968:0:9449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841816.714993:0:9449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a400/0xe3dac0c99affe833 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d68ad expref: -99 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841816.715083:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a400/0xe3dac0c99affe833 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d68ad expref: 49 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841816.715100:0:9449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a400/0xe3dac0c99affe833 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d68ad expref: 49 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841816.715121:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff92cbc57e3a00) 00010000:00010000:0.0:1787841816.715125:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787841816.715128:0:9449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbffa3a400, rc 0) 00000100:00100000:0.0:1787841816.715211:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd449a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+49:10453:x1874687695037056:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 Request processed in 273us (2385us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841816.719645:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841816.721213:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695037184 00000100:00100000:1.0:1787841816.721238:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695037184 00000100:00100000:1.0:1787841816.721338:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 25 00000100:00100000:1.0:1787841816.721347:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd44b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2353:x1874687695037184:12345-192.168.201.1@tcp:8:lhsmtool_posix.0 00010000:00080000:1.0:1787841816.721676:0:6686:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from b2767a54-6703-4908-8414-eab6601e2ceb@192.168.201.1@tcp t0 exp 0000000000000000 cur 356 last 0 00000020:00000080:1.0:1787841816.721755:0:6686:0:(genops.c:1385:class_connect()) connect: client b2767a54-6703-4908-8414-eab6601e2ceb, cookie 0xe3dac0c99affe83a 00002000:00100000:1.0:1787841816.721772:0:6686:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli b2767a54-6703-4908-8414-eab6601e2ceb/ffff92cc00d87800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211395f ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787841816.721887:0:6686:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787841816.722193:0:6686:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787841816.722241:0:6686:0:(import.c:65:import_set_state_nolock()) ffff92cc00d82000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787841816.722742:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd44b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b2767a54-6703-4908-8414-eab6601e2ceb+6:2353:x1874687695037184:12345-192.168.201.1@tcp:8:lhsmtool_posix.0 Request processed in 1391us (3102us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841816.722755:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 25 00000100:00100000:0.0:1787841816.726983:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 76 00000100:00100000:3.0:1787841816.733047:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841816.738530:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695037312 00000100:00100000:2.0:1787841816.738549:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695037312 00000100:00100000:2.0:1787841816.738631:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 26 00000100:00100000:2.0:1787841816.738643:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e2e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b2767a54-6703-4908-8414-eab6601e2ceb+6:0:x1874687695037312:12345-192.168.201.1@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1787841816.739856:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787841816.837205:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff42e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687714987008:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787841816.837319:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841816.838024:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714987008 00000100:00100000:0.0:1787841816.838037:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714987008 00000100:00100000:0.0:1787841816.838098:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787841816.838108:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf90c1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874687714987008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787841816.838138:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787841816.838198:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf90c1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874687714987008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (879us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841816.838217:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787841816.838276:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff42e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687714987008:0@lo:13:osp-pre-0-0.0 00000001:00100000:2.0:1787841816.852096:0:6717:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b2767a54-6703-4908-8414-eab6601e2ceb 00000001:00080000:2.0:1787841816.852132:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000100:00100000:2.0:1787841816.852273:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e2e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b2767a54-6703-4908-8414-eab6601e2ceb+5:0:x1874687695037312:12345-192.168.201.1@tcp:2:lhsmtool_posix.0 Request processed in 113627us (119234us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1787841816.852285:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 26 00000100:00100000:3.0:1787841816.855096:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841816.855322:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695037568 00000100:00100000:2.0:1787841816.855333:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695037568 00000100:00100000:2.0:1787841816.855414:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 19 00000100:00100000:2.0:1787841816.855427:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e2cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b2767a54-6703-4908-8414-eab6601e2ceb+49:10453:x1874687695037568:12345-192.168.201.1@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787841816.855817:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e2cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b2767a54-6703-4908-8414-eab6601e2ceb+50:10453:x1874687695037568:12345-192.168.201.1@tcp:35:lhsmtool_posix.0 Request processed in 391us (737us total) trans 4294967354 rc 0/0 00000100:00100000:2.0:1787841816.855827:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 19 00000100:00100000:3.0:1787841816.858554:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841816.858775:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695037824 00000100:00100000:0.0:1787841816.858787:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695037824 00000100:00100000:0.0:1787841816.858870:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 77 00000100:00100000:0.0:1787841816.858880:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e2e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+50:10453:x1874687695037824:12345-192.168.201.1@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787841816.858998:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e2e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+50:10453:x1874687695037824:12345-192.168.201.1@tcp:57:lhsmtool_posix.0 Request processed in 119us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841816.859007:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 77 00000100:00100000:2.0:1787841816.862211:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841816.862302:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695037952 00000100:00100000:0.0:1787841816.862313:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695037952 00000100:00100000:0.0:1787841816.862397:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 78 00000100:00100000:0.0:1787841816.862408:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbd4a9e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+50:10453:x1874687695037952:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787841816.862435:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841816.862459:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3bc00/0xe3dac0c99affe841 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d68b4 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841816.862545:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b000/0xe3dac0c99affe848 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841816.862560:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b000/0xe3dac0c99affe848 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841816.862572:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b000/0xe3dac0c99affe848 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787841816.862610:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787841816.862650:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b000/0xe3dac0c99affe848 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841816.862678:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3bc00/0xe3dac0c99affe841 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d68b4 expref: 52 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841816.863235:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b000/0xe3dac0c99affe848 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d68b4 expref: 51 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841816.863251:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff92cbc57e3a00) 00010000:00010000:0.0:1787841816.863254:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787841816.863259:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbffa3b000, rc 0) 00000100:00100000:0.0:1787841816.863396:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbd4a9e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+51:10453:x1874687695037952:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 Request processed in 989us (1192us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841816.863405:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 78 00000100:00100000:1.0:1787841816.878666:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841816.879001:0:9572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695038080 00000100:00100000:3.0:1787841816.879012:0:9572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695038080 00000100:00100000:3.0:1787841816.879077:0:9572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 27 00000100:00100000:3.0:1787841816.879089:0:9572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff42c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b2767a54-6703-4908-8414-eab6601e2ceb+5:2357:x1874687695038080:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787841816.879110:0:9572:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841816.879132:0:9572:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000024c0ed/0xe3dac0c99affe84f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d68bb expref: -99 pid: 9572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787841816.879160:0:9572:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a904d19, blocks: 0x1 00010000:00010000:3.0:1787841816.879183:0:9572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=356s v=(0 0) 00010000:00010000:3.0:1787841816.879189:0:9572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787841816.879199:0:9572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000024c0ed/0xe3dac0c99affe84f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d68bb expref: 6 pid: 9572 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841816.879220:0:9572:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000024c0ed/0xe3dac0c99affe84f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d68bb expref: 6 pid: 9572 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841816.879234:0:9572:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc149d600, rc 0) 00000100:00100000:3.0:1787841816.879298:0:9572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff42c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b2767a54-6703-4908-8414-eab6601e2ceb+6:2357:x1874687695038080:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 Request processed in 211us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841816.879306:0:9572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 27 00000100:00100000:0.0:1787841816.884313:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841816.884405:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695038336 00000100:00100000:1.0:1787841816.884415:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695038336 00000100:00100000:1.0:1787841816.884482:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 79 00000100:00100000:1.0:1787841816.884495:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf90c2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+51:10453:x1874687695038336:12345-192.168.201.1@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787841816.884636:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf90c2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+51:10453:x1874687695038336:12345-192.168.201.1@tcp:57:lhsmtool_posix.0 Request processed in 143us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841816.884666:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 79 00000100:00100000:3.0:1787841816.891846:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841816.893099:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695038464 00000100:00100000:0.0:1787841816.893112:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695038464 00000100:00100000:0.0:1787841816.893181:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 28 00000100:00100000:0.0:1787841816.893193:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e2c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b2767a54-6703-4908-8414-eab6601e2ceb+6:10453:x1874687695038464:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787841816.893213:0:6688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841816.893234:0:6688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000070798621/0xe3dac0c99affe856 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d68c2 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841816.893267:0:6688:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000024c0ed/0xe3dac0c99affe84f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d68bb expref: 7 pid: 9572 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841816.893277:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787841816.893291:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787841816.893297:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000070798621/0xe3dac0c99affe856 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d68c2 expref: 7 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841816.893334:0:6688:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000024c0ed/0xe3dac0c99affe84f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d68bb expref: 7 pid: 9572 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841816.893348:0:6688:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000024c0ed/0xe3dac0c99affe84f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d68bb expref: 7 pid: 9572 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841816.893361:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6ca7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6688:1874687714987136:192.168.201.1@tcp:104: 00000100:00100000:0.0:1787841816.894922:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc3896480 going to sleep for 11 seconds 00000100:00100000:3.0:1787841816.913271:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6ca7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6688:1874687714987136:192.168.201.1@tcp:104: 00010000:00010000:3.0:1787841816.913309:0:6688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000070798621/0xe3dac0c99affe856 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d68c2 expref: 7 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841816.913352:0:6688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbffa3bc00, rc 0) 00000100:00100000:3.0:1787841816.914333:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e2c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b2767a54-6703-4908-8414-eab6601e2ceb+7:10453:x1874687695038464:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 Request processed in 21134us (22490us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841816.914358:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 28 00000100:00100000:0.0:1787841816.918688:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841816.919002:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695038592 00000100:00100000:3.0:1787841816.919015:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695038592 00010000:00010000:3.0:1787841816.919063:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000024c0ed/0xe3dac0c99affe84f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d68bb expref: 7 pid: 9572 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841816.919115:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 42 00000100:00100000:3.0:1787841816.919126:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcdb7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b2767a54-6703-4908-8414-eab6601e2ceb+7:2356:x1874687695038592:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787841816.919156:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787841816.919184:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000024c0ed/0xe3dac0c99affe84f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d68bb expref: 7 pid: 9572 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841816.919203:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000024c0ed/0xe3dac0c99affe84f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d68bb expref: 7 pid: 9572 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841816.919233:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000024c0ed/0xe3dac0c99affe84f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d68bb expref: 7 pid: 9572 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841816.919255:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787841816.919260:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787841816.919270:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000070798621/0xe3dac0c99affe856 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d68c2 expref: 6 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841816.919301:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000070798621/0xe3dac0c99affe856 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d68c2 expref: 6 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841816.919350:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000070798621/0xe3dac0c99affe856 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d68c2 expref: 6 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841816.919368:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e2ed00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5824:1874687714987264:192.168.201.1@tcp:105: 00000100:00100000:3.0:1787841816.919467:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbda5da600 going to sleep for 11 seconds 00000100:00100000:3.0:1787841816.933779:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e2ed00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5824:1874687714987264:192.168.201.1@tcp:105: 00010000:00010000:3.0:1787841816.933829:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787841816.933895:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcdb7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b2767a54-6703-4908-8414-eab6601e2ceb+6:2356:x1874687695038592:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 14769us (15219us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841816.933910:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 42 00000100:00100000:2.0:1787841816.946590:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841816.946750:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695038720 00000100:00100000:0.0:1787841816.946761:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695038720 00002000:00100000:0.0:1787841816.946824:0:6694:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff92cbd4a9fc00 x1874687695038720/t0(0) o4->b2767a54-6703-4908-8414-eab6601e2ceb@192.168.201.1@tcp:317/0 lens 504/0 e 0 to 0 dl 1787841827 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787841816.946835:0:6694:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff92cbd4a9fc00 with x1874687695038720 ext(0->8) 00002000:00010000:0.0:1787841816.946841:0:6694:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92cbd4a9fc00 00000100:00100000:0.0:1787841816.946866:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 0 00000100:00100000:0.0:1787841816.946876:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbd4a9fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b2767a54-6703-4908-8414-eab6601e2ceb+6:2357:x1874687695038720:12345-192.168.201.1@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787841816.949200:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbd4a9fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b2767a54-6703-4908-8414-eab6601e2ceb+8:2357:x1874687695038720:12345-192.168.201.1@tcp:4:lhsmtool_posix.0 Request processed in 2311us (2607us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1787841816.949216:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 0 00002000:00100000:0.0:1787841816.949230:0:6694:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff92cbd4a9fc00 x1874687695038720/t4294967302(0) o4->b2767a54-6703-4908-8414-eab6601e2ceb@192.168.201.1@tcp:317/0 lens 504/448 e 0 to 0 dl 1787841827 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787841816.949249:0:6694:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff92cbd4a9fc00 with x1874687695038720 ext(0->8) 00002000:00010000:0.0:1787841816.949257:0:6694:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92cbd4a9fc00 00000100:00100000:0.0:1787841816.955121:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841816.955213:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695038848 00000100:00100000:3.0:1787841816.955225:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695038848 00000100:00100000:3.0:1787841816.955297:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 80 00000100:00100000:3.0:1787841816.955309:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6ca7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+51:10453:x1874687695038848:12345-192.168.201.1@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1787841817.088246:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6ca7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+51:10453:x1874687695038848:12345-192.168.201.1@tcp:44:lhsmtool_posix.0 Request processed in 132927us (133121us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841817.088262:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 80 00000001:00080000:2.0:1787841817.101883:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967353 is committed 00000004:00080000:2.0:1787841817.101900:0:5860:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000001:00080000:2.0:1787841817.101980:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:2.0:1787841817.102023:0:5860:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:2.0:1787841817.102045:0:5860:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff92cbf0518180 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:2.0:1787841817.102050:0:5860:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff92cbe99d9f00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff92cbc2e59b40 00000020:00080000:2.0:1787841817.102054:0:5860:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff92cbe99d9c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff92cbc3ecc400 00000004:00080000:2.0:1787841817.102066:0:5860:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:1.0:1787841817.102287:0:5871:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:1.0:1787841817.102421:0:5871:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:2.0:1787841817.102618:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff42ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874687714987392:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787841817.102685:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841817.102890:0:9572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714987392 00000100:00100000:1.0:1787841817.102897:0:9572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714987392 00000100:00100000:1.0:1787841817.102967:0:9572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787841817.102977:0:9572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbd4a9f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3299:x1874687714987392:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1787841817.103007:0:9572:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:1.0:1787841817.103044:0:9572:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a904d16, atime: 0x6a904d16, ctime: 0x6a904d16, blocks: 0xb 00010000:00010000:1.0:1787841817.103054:0:9572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074300b18/0xe3dac0c99affe85d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841817.103071:0:9572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=357s v=(0 0) 00010000:00010000:1.0:1787841817.103075:0:9572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787841817.103083:0:9572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074300b18/0xe3dac0c99affe85d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841817.103100:0:9572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000074300b18/0xe3dac0c99affe85d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841817.103111:0:9572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074300b18/0xe3dac0c99affe85d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841817.103119:0:9572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000074300b18/0xe3dac0c99affe85d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841817.103160:0:9572:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787841817.103784:0:9572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbd4a9f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3299:x1874687714987392:12345-0@lo:6:osp-syn-1-0.0 Request processed in 807us (1097us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1787841817.103805:0:9572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:1.0:1787841817.103841:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787841817.103849:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000074300b18/0xe3dac0c99affe85d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841817.103859:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cc00d9de00 already unused, calling callback (ffffffffc17a4500) 00010000:00010000:1.0:1787841817.103864:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000074300b18/0xe3dac0c99affe85d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841817.103874:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000074300b18/0xe3dac0c99affe85d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841817.103891:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000074300b18/0xe3dac0c99affe85d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841817.103898:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000074300b18/0xe3dac0c99affe85d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841817.103918:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841817.103920:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841817.103922:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787841817.103957:0:3299:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff92cbff42ed00/2, rc 0, transno 4294967301 00000100:00100000:1.0:1787841817.103964:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff42ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874687714987392:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787841817.104272:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787841817.104283:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6ca61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874687714987520:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1787841817.104320:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787841817.105281:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787841817.106036:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714987520 00000100:00100000:2.0:1787841817.106052:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714987520 00000100:00100000:2.0:1787841817.106159:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787841817.106170:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6ca43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1874687714987520:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1787841817.106388:0:6687:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1787841817.106392:0:6687:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787841817 00002000:00010000:2.0:1787841817.106395:0:6687:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787841817.106397:0:6687:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787841817 -> 1787841817 00002000:00010000:2.0:1787841817.106400:0:6687:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1787841817.106520:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6ca43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3301:x1874687714987520:12345-0@lo:2:osp-syn-0-0.0 Request processed in 352us (2198us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1787841817.106528:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:0.0:1787841817.106611:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1787841817.106633:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff92cbf6ca61c0/2, rc 0, transno 4294967303 00000100:00100000:1.0:1787841817.106641:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6ca61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874687714987520:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787841817.109538:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841817.109865:0:9572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695038976 00000100:00100000:1.0:1787841817.109877:0:9572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695038976 00000100:00100000:2.0:1787841817.110118:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 31 00000100:00100000:2.0:1787841817.110153:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e2ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b2767a54-6703-4908-8414-eab6601e2ceb+8:2357:x1874687695038976:12345-192.168.201.1@tcp:16:lhsmtool_posix.0 00010000:00010000:2.0:1787841817.157332:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787841817.165310:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00080000:2.0:1787841817.165333:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:1.0:1787841817.165657:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e2ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b2767a54-6703-4908-8414-eab6601e2ceb+6:2357:x1874687695038976:12345-192.168.201.1@tcp:16:lhsmtool_posix.0 Request processed in 55502us (56123us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841817.165669:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 31 00000100:00100000:2.0:1787841817.170223:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841817.170478:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695039232 00000100:00100000:1.0:1787841817.170490:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695039232 00000100:00100000:1.0:1787841817.170684:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 81 00000100:00100000:1.0:1787841817.170694:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbd4a9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+13:10453:x1874687695039232:12345-192.168.201.1@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787841817.170785:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787841817.170820:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b000/0xe3dac0c99affe848 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d68b4 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841817.170841:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff92cbc57e3a00) 00010000:00010000:1.0:1787841817.170846:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787841817.170883:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affe864 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841817.170899:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affe864 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841817.170909:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affe864 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787841817.171162:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fd0d10b0 reply state 00000000a4767d98 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affe864 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841817.171189:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787841817.171288:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbd4a9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+14:10453:x1874687695039232:12345-192.168.201.1@tcp:36:lhsmtool_posix.0 Request processed in 596us (1078us total) trans 4294967355 rc 0/0 00000100:00100000:1.0:1787841817.171296:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 81 00000100:00080000:2.0:1787841817.171368:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787841817.179766:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affe864 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841817.179789:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affe864 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841817.179798:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affe864 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841817.179820:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cc00d9de00 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:3.0:1787841817.179826:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affe864 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841817.179836:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affe864 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841817.179857:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff92cbc57e3a00) 00010000:00010000:3.0:1787841817.179860:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787841817.179866:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affe864 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841817.179872:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affe864 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841817.181399:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841817.182640:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695039360 00000100:00100000:1.0:1787841817.182653:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695039360 00000100:00100000:1.0:1787841817.182956:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 32 00000100:00100000:1.0:1787841817.182970:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf04c43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b2767a54-6703-4908-8414-eab6601e2ceb+6:2356:x1874687695039360:12345-192.168.201.1@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787841817.183285:0:6688:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1787841817.183290:0:6688:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1787841817 -> 1787841816 00002000:00010000:1.0:1787841817.183293:0:6688:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787841814 00002000:00010000:1.0:1787841817.183295:0:6688:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787841817 -> 1787841816 00002000:00010000:1.0:1787841817.183297:0:6688:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1787841817.183403:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf04c43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b2767a54-6703-4908-8414-eab6601e2ceb+7:2356:x1874687695039360:12345-192.168.201.1@tcp:2:lhsmtool_posix.0 Request processed in 436us (2013us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1787841817.183412:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 32 00000100:00100000:0.0:1787841817.188258:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841817.188358:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695039616 00000100:00100000:2.0:1787841817.188384:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695039616 00000100:00100000:2.0:1787841817.188440:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 82 00000100:00100000:2.0:1787841817.188450:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6ca7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+13:10453:x1874687695039616:12345-192.168.201.1@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787841817.188536:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598200/0xe3dac0c99affe86b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841817.188554:0:9449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a000/0xe3dac0c99affe825 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d68a6 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841817.188564:0:9449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598200/0xe3dac0c99affe86b lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841817.188602:0:9449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a000/0xe3dac0c99affe825 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d68a6 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841817.188616:0:9449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a000/0xe3dac0c99affe825 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d68a6 expref: 13 pid: 5839 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841817.188630:0:9449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf04c61c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9449:1874687714987648:192.168.201.1@tcp:104: 00000100:00100000:2.0:1787841817.188745:0:9449:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbda4d1000 going to sleep for 11 seconds 00000100:00100000:3.0:1787841817.192374:0:9449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf04c61c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9449:1874687714987648:192.168.201.1@tcp:104: 00010000:00010000:3.0:1787841817.192425:0:9449:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598200/0xe3dac0c99affe86b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841817.194738:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841817.194927:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695039744 00000100:00100000:2.0:1787841817.194939:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695039744 00010000:00010000:2.0:1787841817.194994:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a000/0xe3dac0c99affe825 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d68a6 expref: 14 pid: 5839 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841817.195040:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 43 00000100:00100000:2.0:1787841817.195050:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff3e92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b2767a54-6703-4908-8414-eab6601e2ceb+14:2356:x1874687695039744:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787841817.195068:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787841817.195075:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a000/0xe3dac0c99affe825 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d68a6 expref: 14 pid: 5839 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841817.195090:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a000/0xe3dac0c99affe825 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d68a6 expref: 14 pid: 5839 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841817.195118:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a000/0xe3dac0c99affe825 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d68a6 expref: 14 pid: 5839 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841817.195138:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff92cbc57e3a00) 00010000:00010000:2.0:1787841817.195144:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598200/0xe3dac0c99affe86b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841817.195155:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598200/0xe3dac0c99affe86b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841817.195163:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598200/0xe3dac0c99affe86b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841817.195196:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787841817.195271:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff3e92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b2767a54-6703-4908-8414-eab6601e2ceb+13:2356:x1874687695039744:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 222us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841817.195296:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 43 00010000:00010000:3.0:1787841817.195735:0:9449:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598200/0xe3dac0c99affe86b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841817.195745:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598200/0xe3dac0c99affe86b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841817.195780:0:9449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598200/0xe3dac0c99affe86b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841817.195787:0:9449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598200/0xe3dac0c99affe86b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841817.195806:0:9449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598200/0xe3dac0c99affe86b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841817.195813:0:9449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6598200 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:3.0:1787841817.195818:0:9449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598200/0xe3dac0c99affe86b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841817.195826:0:9449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598200/0xe3dac0c99affe86b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841817.195836:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff92cbc57e3a00) 00010000:00010000:3.0:1787841817.195839:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787841817.195843:0:9449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598200/0xe3dac0c99affe86b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841817.195850:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598200/0xe3dac0c99affe86b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841817.195905:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6ca7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+12:10453:x1874687695039616:12345-192.168.201.1@tcp:55:lhsmtool_posix.0 Request processed in 7456us (7657us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787841817.195914:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 82 00000100:00100000:0.0:1787841817.200341:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841817.200515:0:9572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695039872 00000100:00100000:2.0:1787841817.200525:0:9572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695039872 00000100:00100000:2.0:1787841817.200649:0:9572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 33 00000100:00100000:2.0:1787841817.200660:0:9572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff3e9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b2767a54-6703-4908-8414-eab6601e2ceb+7:2357:x1874687695039872:12345-192.168.201.1@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787841817.200753:0:9572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006f2ae4bd/0xe3dac0c99affe872 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841817.200775:0:9572:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000070798621/0xe3dac0c99affe856 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d68c2 expref: 7 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841817.200784:0:9572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1787841817.200789:0:9572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787841817.200794:0:9572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f2ae4bd/0xe3dac0c99affe872 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841817.200830:0:9572:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000070798621/0xe3dac0c99affe856 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d68c2 expref: 7 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841817.200845:0:9572:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000070798621/0xe3dac0c99affe856 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d68c2 expref: 7 pid: 6688 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841817.200859:0:9572:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf04c7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9572:1874687714987776:192.168.201.1@tcp:104: 00000100:00100000:2.0:1787841817.200943:0:9572:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbda4d1000 going to sleep for 11 seconds 00000100:00100000:3.0:1787841817.206263:0:9572:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf04c7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9572:1874687714987776:192.168.201.1@tcp:104: 00000100:00100000:0.0:1787841817.206263:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00010000:00010000:3.0:1787841817.206300:0:9572:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006f2ae4bd/0xe3dac0c99affe872 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841817.206304:0:7633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695040000 00000100:00100000:0.0:1787841817.206309:0:7633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695040000 00010000:00010000:0.0:1787841817.206345:0:7633:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000070798621/0xe3dac0c99affe856 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d68c2 expref: 8 pid: 6688 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841817.206402:0:7633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 44 00000100:00100000:0.0:1787841817.206413:0:7633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff3e9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b2767a54-6703-4908-8414-eab6601e2ceb+8:2357:x1874687695040000:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787841817.206431:0:7633:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787841817.206464:0:7633:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000070798621/0xe3dac0c99affe856 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d68c2 expref: 8 pid: 6688 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841817.206479:0:7633:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000070798621/0xe3dac0c99affe856 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d68c2 expref: 8 pid: 6688 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841817.206505:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000070798621/0xe3dac0c99affe856 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d68c2 expref: 8 pid: 6688 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841817.206537:0:7633:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787841817.206542:0:7633:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787841817.206548:0:7633:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006f2ae4bd/0xe3dac0c99affe872 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841817.206559:0:7633:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f2ae4bd/0xe3dac0c99affe872 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841817.206585:0:7633:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787841817.206619:0:9572:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006f2ae4bd/0xe3dac0c99affe872 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841817.206641:0:9572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006f2ae4bd/0xe3dac0c99affe872 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841817.206643:0:7633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff3e9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b2767a54-6703-4908-8414-eab6601e2ceb+7:2357:x1874687695040000:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 232us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841817.206651:0:7633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 44 00010000:00010000:3.0:1787841817.206665:0:9572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006f2ae4bd/0xe3dac0c99affe872 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841817.206674:0:9572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006f2ae4bd/0xe3dac0c99affe872 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841817.206681:0:9572:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006f2ae4bd/0xe3dac0c99affe872 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841817.206688:0:9572:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6598e00 already unused, calling callback (ffffffffc17a4500) 00010000:00010000:3.0:1787841817.206692:0:9572:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006f2ae4bd/0xe3dac0c99affe872 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841817.206729:0:9572:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006f2ae4bd/0xe3dac0c99affe872 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841817.206742:0:9572:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006f2ae4bd/0xe3dac0c99affe872 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841817.207298:0:9572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006f2ae4bd/0xe3dac0c99affe872 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841817.207404:0:9572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff3e9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b2767a54-6703-4908-8414-eab6601e2ceb+6:2357:x1874687695039872:12345-192.168.201.1@tcp:1:lhsmtool_posix.0 Request processed in 6744us (7073us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841817.207415:0:9572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 33 00000100:00100000:1.0:1787841817.230096:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841817.230164:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695040256 00000100:00100000:2.0:1787841817.230186:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695040256 00000100:00100000:2.0:1787841817.230254:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 83 00000100:00100000:2.0:1787841817.230265:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff42d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+12:10453:x1874687695040256:12345-192.168.201.1@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787841817.230806:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599a00/0xe3dac0c99affe879 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841817.230825:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599a00/0xe3dac0c99affe879 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841817.230838:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599a00/0xe3dac0c99affe879 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841817.231053:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599800/0xe3dac0c99affe880 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841817.231066:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a400/0xe3dac0c99affe833 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d68ad expref: 13 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841817.231075:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599800/0xe3dac0c99affe880 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841817.231114:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a400/0xe3dac0c99affe833 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d68ad expref: 13 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841817.231131:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a400/0xe3dac0c99affe833 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d68ad expref: 13 pid: 9449 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841817.231147:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf04c4000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1874687714987904:192.168.201.1@tcp:104: 00000100:00100000:2.0:1787841817.231310:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbcdb29540 going to sleep for 11 seconds 00000100:00100000:3.0:1787841817.242122:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841817.244299:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf04c4000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1874687714987904:192.168.201.1@tcp:104: 00010000:00010000:2.0:1787841817.244350:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599800/0xe3dac0c99affe880 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841817.247649:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695040384 00000100:00100000:3.0:1787841817.247663:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695040384 00010000:00010000:3.0:1787841817.252284:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a400/0xe3dac0c99affe833 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d68ad expref: 14 pid: 9449 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841817.252361:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 45 00000100:00100000:3.0:1787841817.252378:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e2d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b2767a54-6703-4908-8414-eab6601e2ceb+14:2357:x1874687695040384:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787841817.252399:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787841817.252406:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a400/0xe3dac0c99affe833 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d68ad expref: 14 pid: 9449 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841817.252421:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a400/0xe3dac0c99affe833 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d68ad expref: 14 pid: 9449 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841817.252446:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a400/0xe3dac0c99affe833 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d68ad expref: 14 pid: 9449 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841817.252459:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff92cbc57e3a00) 00010000:00010000:3.0:1787841817.252465:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599800/0xe3dac0c99affe880 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841817.252474:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599800/0xe3dac0c99affe880 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841817.252490:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599800/0xe3dac0c99affe880 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841817.253550:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787841817.253615:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e2d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b2767a54-6703-4908-8414-eab6601e2ceb+13:2357:x1874687695040384:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 1240us (11497us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841817.253625:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 45 00010000:00010000:2.0:1787841817.254505:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599800/0xe3dac0c99affe880 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841817.254518:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599800/0xe3dac0c99affe880 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787841817.254757:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:2.0:1787841817.254932:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:2.0:1787841817.254980:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:2.0:1787841817.255070:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf04c4000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5837:1874687714988032:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787841817.255142:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841817.255178:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbf0784c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787841817.255206:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714988032 00000100:00100000:2.0:1787841817.255214:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714988032 00000100:00100000:2.0:1787841817.255256:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787841817.255264:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf04c4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5837:x1874687714988032:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787841817.255349:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf04c4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5837:x1874687714988032:12345-0@lo:1000:mdt00_000.0 Request processed in 84us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841817.255356:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787841817.256571:0:5837:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:2.0:1787841817.256583:0:5837:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff92cbf6ca61c0, transno 4294967303 00000100:00100000:2.0:1787841817.256607:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf04c4000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5837:1874687714988032:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1787841817.259609:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:2.0:1787841817.259749:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf04c4000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5837:1874687714988160:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787841817.259829:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841817.259873:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbcdb29540 going to sleep for 11 seconds 00000100:00100000:2.0:1787841817.259903:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714988160 00000100:00100000:2.0:1787841817.259910:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714988160 00000100:00100000:2.0:1787841817.259953:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787841817.259961:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf04c6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5837:x1874687714988160:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787841817.260203:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf04c6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5837:x1874687714988160:12345-0@lo:1000:mdt00_000.0 Request processed in 238us (370us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1787841817.260211:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787841817.260260:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf04c4000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5837:1874687714988160:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1787841817.260311:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599800/0xe3dac0c99affe880 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841817.260322:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599800/0xe3dac0c99affe880 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841817.260331:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599800/0xe3dac0c99affe880 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841817.260337:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6599800 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:2.0:1787841817.260343:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599800/0xe3dac0c99affe880 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841817.260350:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599800/0xe3dac0c99affe880 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841817.260368:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff92cbc57e3a00) 00010000:00010000:2.0:1787841817.260371:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787841817.260375:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599800/0xe3dac0c99affe880 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841817.260382:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599800/0xe3dac0c99affe880 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841817.260437:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99affe7ae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841817.260443:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99affe7ae lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841817.260450:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99affe7ae lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841817.260455:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbffa3be00 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:2.0:1787841817.260458:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99affe7ae lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841817.260464:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99affe7ae lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841817.260473:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92cbc57e3100) 00010000:00010000:2.0:1787841817.260475:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787841817.260478:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99affe7ae lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841817.260483:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99affe7ae lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841817.260520:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599000/0xe3dac0c99affe887 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841817.260535:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149de00/0xe3dac0c99affe7ca lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6891 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841817.260544:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599000/0xe3dac0c99affe887 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841817.260578:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149de00/0xe3dac0c99affe7ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6891 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841817.260595:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149de00/0xe3dac0c99affe7ca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6891 expref: 16 pid: 5837 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841817.260606:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf04c70c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1874687714988288:192.168.201.1@tcp:104: 00000100:00100000:2.0:1787841817.260660:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc8d39b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787841817.274681:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841817.274744:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695040512 00000100:00100000:0.0:1787841817.274752:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695040512 00010000:00010000:0.0:1787841817.274803:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149de00/0xe3dac0c99affe7ca lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6891 expref: 17 pid: 5837 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841817.274836:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 46 00000100:00100000:0.0:1787841817.274845:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff3e8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b2767a54-6703-4908-8414-eab6601e2ceb+17:2356:x1874687695040512:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787841817.274861:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787841817.276120:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149de00/0xe3dac0c99affe7ca lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6891 expref: 17 pid: 5837 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841817.276154:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149de00/0xe3dac0c99affe7ca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6891 expref: 17 pid: 5837 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841817.276213:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92cbc57e3100) 00010000:00010000:0.0:1787841817.276219:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599000/0xe3dac0c99affe887 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841817.276230:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599000/0xe3dac0c99affe887 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841817.276238:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599000/0xe3dac0c99affe887 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841817.276263:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787841817.277494:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff3e8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b2767a54-6703-4908-8414-eab6601e2ceb+17:2356:x1874687695040512:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 2641us (2814us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841817.277507:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 46 00010000:00010000:0.0:1787841817.277581:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149de00/0xe3dac0c99affe7ca lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6891 expref: 16 pid: 5837 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841817.277600:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf04c70c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1874687714988288:192.168.201.1@tcp:104: 00010000:00010000:0.0:1787841817.277624:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599000/0xe3dac0c99affe887 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841817.277633:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599000/0xe3dac0c99affe887 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841817.277639:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599000/0xe3dac0c99affe887 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841817.277651:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599000/0xe3dac0c99affe887 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841817.277666:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599000/0xe3dac0c99affe887 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841817.277673:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599000/0xe3dac0c99affe887 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841817.277679:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6599000 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:0.0:1787841817.277684:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599000/0xe3dac0c99affe887 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841817.277692:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599000/0xe3dac0c99affe887 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841817.277731:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92cbc57e3100) 00010000:00010000:0.0:1787841817.277734:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841817.277739:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599000/0xe3dac0c99affe887 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841817.277745:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599000/0xe3dac0c99affe887 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841817.277759:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599a00/0xe3dac0c99affe879 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841817.277765:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599a00/0xe3dac0c99affe879 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841817.277771:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599a00/0xe3dac0c99affe879 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841817.277777:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6599a00 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:0.0:1787841817.277787:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599a00/0xe3dac0c99affe879 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841817.277794:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599a00/0xe3dac0c99affe879 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841817.277803:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92cbc57e3100) 00010000:00010000:0.0:1787841817.277806:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787841817.277809:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599a00/0xe3dac0c99affe879 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841817.277815:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599a00/0xe3dac0c99affe879 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841817.278099:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff42d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+15:10453:x1874687695040256:12345-192.168.201.1@tcp:57:lhsmtool_posix.0 Request processed in 47834us (48012us total) trans 4294967360 rc 0/0 00000100:00100000:0.0:1787841817.278110:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 83 00000020:00080000:0.0:1787841817.278115:0:5837:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1787841817.278260:0:11682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787841817.278266:0:11682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787841817.278320:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1787841817.278327:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787841817.284131:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841817.284985:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695040768 00000100:00100000:2.0:1787841817.284999:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695040768 00000100:00100000:2.0:1787841817.285063:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 20 00000100:00100000:2.0:1787841817.285076:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e2fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b2767a54-6703-4908-8414-eab6601e2ceb+15:10453:x1874687695040768:12345-192.168.201.1@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787841817.286300:0:5840:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787841817.286655:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:2.0:1787841817.286935:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598e00/0xe3dac0c99affe88e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841817.286954:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598e00/0xe3dac0c99affe88e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841817.286967:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598e00/0xe3dac0c99affe88e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841817.286976:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598e00/0xe3dac0c99affe88e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841817.286982:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598e00/0xe3dac0c99affe88e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841817.287002:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598e00/0xe3dac0c99affe88e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841817.287064:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787841817.287179:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e2fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b2767a54-6703-4908-8414-eab6601e2ceb+17:10453:x1874687695040768:12345-192.168.201.1@tcp:35:lhsmtool_posix.0 Request processed in 2099us (3053us total) trans 4294967362 rc 0/0 00000100:00100000:2.0:1787841817.287190:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 20 00000020:00080000:2.0:1787841817.287198:0:5840:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787841817.294673:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787841817.294687:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598e00/0xe3dac0c99affe88e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841817.296504:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6598e00 already unused, calling callback (ffffffffc17a4500) 00010000:00010000:3.0:1787841817.296510:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598e00/0xe3dac0c99affe88e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841817.296522:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598e00/0xe3dac0c99affe88e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841817.296545:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff92cbc3b04800) 00010000:00010000:3.0:1787841817.296548:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787841817.296555:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598e00/0xe3dac0c99affe88e lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841817.296562:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598e00/0xe3dac0c99affe88e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841817.297129:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841817.297134:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841817.297137:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787841817.682052:0:12001:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787841817.682063:0:12001:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787841817.682116:0:12001:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1787841817.682121:0:12001:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787841817.752394:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841817.752440:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841817.752854:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841817.752887:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695041024 00000100:00100000:0.0:1787841817.752898:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695041024 00000100:00100000:0.0:1787841817.752981:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 66 00000100:00100000:0.0:1787841817.752991:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf07f9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b2767a54-6703-4908-8414-eab6601e2ceb+5:2355:x1874687695041024:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:0.0:1787841817.753084:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf07f9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b2767a54-6703-4908-8414-eab6601e2ceb+5:2355:x1874687695041024:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 95us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841817.753111:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 66 00000100:00080000:0.0:1787841817.753138:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787841817.757960:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695040896 00000100:00100000:1.0:1787841817.757977:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695040896 00000100:00100000:1.0:1787841817.758066:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 298 00000100:00100000:1.0:1787841817.758076:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a1f1ce-26b5-4cc6-a1db-8e09063432da+13:2355:x1874687695040896:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:1.0:1787841817.758161:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a1f1ce-26b5-4cc6-a1db-8e09063432da+13:2355:x1874687695040896:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 86us (5780us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841817.758169:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 298 00000100:00100000:3.0:1787841817.762721:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695041152 00000100:00100000:3.0:1787841817.762736:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695041152 00000100:00100000:3.0:1787841817.762817:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 154 00000100:00100000:3.0:1787841817.762841:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff3eb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fe7d2185-ae43-428e-8bfa-909f60138853+5:2355:x1874687695041152:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:3.0:1787841817.762918:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff3eb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fe7d2185-ae43-428e-8bfa-909f60138853+5:2355:x1874687695041152:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 78us (10477us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841817.762925:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 154 00000100:00080000:1.0:1787841817.766599:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787841817.916449:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841817.916611:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695041408 00000100:00100000:1.0:1787841817.916622:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695041408 00000100:00100000:1.0:1787841817.916683:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 84 00000100:00100000:1.0:1787841817.916694:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e2c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2767a54-6703-4908-8414-eab6601e2ceb+17:10472:x1874687695041408:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:1.0:1787841817.916748:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841817.916768:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c800/0xe3dac0c99affe895 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d68c9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841817.917125:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c200/0xe3dac0c99affe89c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841817.917140:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c200/0xe3dac0c99affe89c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841817.917151:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c200/0xe3dac0c99affe89c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787841817.917162:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:1.0:1787841817.917323:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c800/0xe3dac0c99affe895 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d68c9 expref: 20 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841817.917342:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c200/0xe3dac0c99affe89c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d68c9 expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841817.917351:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92cbd1fc7300) 00010000:00010000:1.0:1787841817.917360:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787841817.917364:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cc00d9c200, rc 0) 00000100:00100000:1.0:1787841817.917435:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e2c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2767a54-6703-4908-8414-eab6601e2ceb+19:10472:x1874687695041408:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 743us (996us total) trans 4294967363 rc 0/0 00000100:00100000:1.0:1787841817.917443:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 84 00000100:00100000:0.0:1787841817.943504:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841817.943599:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695041536 00000100:00100000:3.0:1787841817.943609:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695041536 00000100:00100000:3.0:1787841817.943668:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 85 00000100:00100000:3.0:1787841817.943678:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf07fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+19:10472:x1874687695041536:12345-192.168.201.1@tcp:34:lfs.0 00010000:00010000:3.0:1787841817.943787:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affe8aa lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841817.943805:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affe8aa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841817.943817:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affe8aa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841817.943832:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affe8b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841817.943840:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affe8b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841817.943847:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affe8b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841817.944152:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affe8b8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841817.944172:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affe8b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841817.944179:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affe8b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787841817.944219:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affe8b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841817.944231:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affe8aa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841817.944238:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affe8aa lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841817.944245:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affe8aa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841817.944250:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc149d600 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:3.0:1787841817.944254:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affe8aa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841817.944261:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affe8aa lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841817.944272:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92cbd1fc7300) 00010000:00010000:3.0:1787841817.944275:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787841817.944281:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affe8aa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841817.944287:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affe8aa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841817.944306:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affe8b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841817.944312:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affe8b1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841817.944318:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affe8b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841817.944324:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc149c400 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:3.0:1787841817.944327:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affe8b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841817.944332:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affe8b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841817.944339:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff92cbc89cdb00) 00010000:00010000:3.0:1787841817.944342:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787841817.944345:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affe8b1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841817.944351:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affe8b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841817.944363:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affe8b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841817.944369:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affe8b8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841817.944374:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affe8b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841817.944384:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc149d400 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:3.0:1787841817.944387:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affe8b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841817.944393:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affe8b8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841817.944401:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92cbc89cd000) 00010000:00010000:3.0:1787841817.944403:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787841817.944406:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affe8b8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841817.944411:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affe8b8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841817.944481:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf07fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+19:10472:x1874687695041536:12345-192.168.201.1@tcp:34:lfs.0 Request processed in 804us (987us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841817.944490:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 85 00000100:00100000:2.0:1787841818.029177:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841818.029215:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695041792 00000100:00100000:2.0:1787841818.029225:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695041792 00000100:00100000:2.0:1787841818.029284:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 86 00000100:00100000:2.0:1787841818.029294:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf04c6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+19:10475:x1874687695041792:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:2.0:1787841818.029315:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841818.029336:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598200/0xe3dac0c99affe8bf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d68d0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841818.029411:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599800/0xe3dac0c99affe8c6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841818.029430:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599800/0xe3dac0c99affe8c6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841818.029443:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599800/0xe3dac0c99affe8c6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841818.029478:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598e00/0xe3dac0c99affe8cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841818.029486:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598e00/0xe3dac0c99affe8cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841818.029492:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598e00/0xe3dac0c99affe8cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841818.029840:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599a00/0xe3dac0c99affe8d4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841818.029850:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599a00/0xe3dac0c99affe8d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841818.029856:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599a00/0xe3dac0c99affe8d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787841818.029873:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1787841818.032167:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599800/0xe3dac0c99affe8c6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841818.032186:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599800/0xe3dac0c99affe8c6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841818.032195:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599800/0xe3dac0c99affe8c6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841818.032201:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6599800 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:2.0:1787841818.032206:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599800/0xe3dac0c99affe8c6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841818.032234:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599800/0xe3dac0c99affe8c6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841818.032251:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92cbd1fc7300) 00010000:00010000:2.0:1787841818.032254:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787841818.032260:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599800/0xe3dac0c99affe8c6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841818.032267:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599800/0xe3dac0c99affe8c6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841818.032282:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598e00/0xe3dac0c99affe8cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841818.032288:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598e00/0xe3dac0c99affe8cd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841818.032294:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598e00/0xe3dac0c99affe8cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841818.032300:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6598e00 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:2.0:1787841818.032303:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598e00/0xe3dac0c99affe8cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841818.032310:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598e00/0xe3dac0c99affe8cd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841818.032318:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff92cbc3b04500) 00010000:00010000:2.0:1787841818.032320:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787841818.032324:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598e00/0xe3dac0c99affe8cd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841818.032341:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598e00/0xe3dac0c99affe8cd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841818.032406:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598200/0xe3dac0c99affe8bf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d68d0 expref: 22 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841818.032421:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599a00/0xe3dac0c99affe8d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d68d0 expref: 21 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841818.032429:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92cbc3b04c00) 00010000:00010000:2.0:1787841818.032431:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787841818.032434:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc6599a00, rc 0) 00000100:00100000:2.0:1787841818.032509:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf04c6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+21:10475:x1874687695041792:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 3215us (3341us total) trans 4294967364 rc 0/0 00000100:00100000:2.0:1787841818.032519:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 86 00000100:00100000:3.0:1787841818.037445:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841818.037478:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695041920 00000100:00100000:3.0:1787841818.037487:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695041920 00000100:00100000:3.0:1787841818.041828:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 87 00000100:00100000:3.0:1787841818.041850:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e2d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+21:10475:x1874687695041920:12345-192.168.201.1@tcp:54:lfs.0 00010000:00010000:3.0:1787841818.041931:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149cc00/0xe3dac0c99affe8e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841818.041965:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149cc00/0xe3dac0c99affe8e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841818.041997:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149cc00/0xe3dac0c99affe8e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841818.042336:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149cc00/0xe3dac0c99affe8e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841818.042344:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149cc00/0xe3dac0c99affe8e2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841818.042351:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149cc00/0xe3dac0c99affe8e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841818.042358:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc149cc00 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:3.0:1787841818.042363:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149cc00/0xe3dac0c99affe8e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841818.042370:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149cc00/0xe3dac0c99affe8e2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841818.042383:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92cbc3b04c00) 00010000:00010000:3.0:1787841818.042386:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787841818.042391:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149cc00/0xe3dac0c99affe8e2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841818.042398:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149cc00/0xe3dac0c99affe8e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841818.042492:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e2d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+21:10475:x1874687695041920:12345-192.168.201.1@tcp:54:lfs.0 Request processed in 649us (5050us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841818.042502:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 87 00000100:00100000:2.0:1787841818.048824:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841818.048982:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695042176 00000100:00100000:3.0:1787841818.049010:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695042176 00000100:00100000:3.0:1787841818.049081:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 21 00000100:00100000:3.0:1787841818.049092:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbc6c30450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b2767a54-6703-4908-8414-eab6601e2ceb+21:10475:x1874687695042176:12345-192.168.201.1@tcp:35:lfs.0 00000100:00100000:3.0:1787841818.049378:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbc6c30450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b2767a54-6703-4908-8414-eab6601e2ceb+22:10475:x1874687695042176:12345-192.168.201.1@tcp:35:lfs.0 Request processed in 287us (563us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1787841818.049386:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 21 00000100:00100000:1.0:1787841818.131205:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841818.131359:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695042432 00000100:00100000:2.0:1787841818.131375:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695042432 00000100:00100000:2.0:1787841818.131436:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 88 00000100:00100000:2.0:1787841818.131446:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff42fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+22:10003:x1874687695042432:12345-192.168.201.1@tcp:101:bash.0 00010000:00010000:2.0:1787841818.131471:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841818.131833:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598200/0xe3dac0c99affe8e9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d68d7 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841818.131937:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598e00/0xe3dac0c99affe8f0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841818.131970:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599a00/0xe3dac0c99affe8d4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d68d0 expref: 23 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841818.131981:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598e00/0xe3dac0c99affe8f0 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841818.132017:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599a00/0xe3dac0c99affe8d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d68d0 expref: 23 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841818.132030:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599a00/0xe3dac0c99affe8d4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d68d0 expref: 23 pid: 5837 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841818.132044:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf04c70c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1874687714988416:192.168.201.1@tcp:104: 00000100:00100000:2.0:1787841818.132138:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc8d39000 going to sleep for 11 seconds 00000100:00100000:2.0:1787841818.137985:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841818.138845:0:7633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695042560 00000100:00100000:1.0:1787841818.138856:0:7633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695042560 00010000:00010000:1.0:1787841818.138902:0:7633:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599a00/0xe3dac0c99affe8d4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d68d0 expref: 24 pid: 5837 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841818.138949:0:7633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 47 00000100:00100000:1.0:1787841818.138959:0:7633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf04c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b2767a54-6703-4908-8414-eab6601e2ceb+24:2356:x1874687695042560:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787841818.138976:0:7633:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787841818.138983:0:7633:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599a00/0xe3dac0c99affe8d4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d68d0 expref: 24 pid: 5837 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841818.138997:0:7633:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599a00/0xe3dac0c99affe8d4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d68d0 expref: 24 pid: 5837 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841818.139020:0:7633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92cbc3b04c00) 00010000:00010000:1.0:1787841818.139026:0:7633:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598e00/0xe3dac0c99affe8f0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841818.139036:0:7633:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598e00/0xe3dac0c99affe8f0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841818.139044:0:7633:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598e00/0xe3dac0c99affe8f0 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841818.139078:0:7633:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787841818.139150:0:7633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf04c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b2767a54-6703-4908-8414-eab6601e2ceb+24:2356:x1874687695042560:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 192us (1178us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841818.139158:0:7633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 47 00010000:00010000:0.0:1787841818.145752:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599a00/0xe3dac0c99affe8d4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d68d0 expref: 23 pid: 5837 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841818.145786:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf04c70c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1874687714988416:192.168.201.1@tcp:104: 00010000:00010000:0.0:1787841818.145813:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598e00/0xe3dac0c99affe8f0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841818.145824:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598e00/0xe3dac0c99affe8f0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841818.145831:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598e00/0xe3dac0c99affe8f0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787841818.145854:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1787841818.146014:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598200/0xe3dac0c99affe8e9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d68d7 expref: 24 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841818.146029:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598e00/0xe3dac0c99affe8f0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d68d7 expref: 23 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841818.146038:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92cbc3b04c00) 00010000:00010000:0.0:1787841818.146041:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787841818.146045:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc6598e00, rc 0) 00000100:00100000:0.0:1787841818.146123:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff42fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+23:10003:x1874687695042432:12345-192.168.201.1@tcp:101:bash.0 Request processed in 14677us (14926us total) trans 4294967366 rc 0/0 00000100:00100000:0.0:1787841818.146148:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 88 00000100:00100000:2.0:1787841818.158294:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841818.158871:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695042816 00000100:00100000:3.0:1787841818.158882:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695042816 00000100:00100000:3.0:1787841818.158947:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 89 00000100:00100000:3.0:1787841818.158956:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf04c61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+23:10003:x1874687695042816:12345-192.168.201.1@tcp:36:bash.0 00010000:00010000:3.0:1787841818.159237:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149cc00/0xe3dac0c99affe8fe lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841818.159255:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149cc00/0xe3dac0c99affe8fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841818.159267:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149cc00/0xe3dac0c99affe8fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787841818.159319:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:3.0:1787841818.159345:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000954f7113 reply state 000000000b20b084 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149cc00/0xe3dac0c99affe8fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841818.159353:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1787841818.159395:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:3.0:1787841818.160062:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf04c61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+27:10003:x1874687695042816:12345-192.168.201.1@tcp:36:bash.0 Request processed in 1103us (1777us total) trans 4294967369 rc 0/0 00000100:00100000:3.0:1787841818.160072:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 89 00000020:00080000:3.0:1787841818.160078:0:5839:0:(tgt_main.c:785:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1787841818.176247:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00010000:00010000:3.0:1787841818.178490:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149cc00/0xe3dac0c99affe8fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841818.178523:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149cc00/0xe3dac0c99affe8fe lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841818.178532:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149cc00/0xe3dac0c99affe8fe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841818.178538:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc149cc00 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:3.0:1787841818.178542:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149cc00/0xe3dac0c99affe8fe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841818.178551:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149cc00/0xe3dac0c99affe8fe lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841818.178568:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92cbc3b04c00) 00010000:00010000:3.0:1787841818.178571:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787841818.178576:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149cc00/0xe3dac0c99affe8fe lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841818.178583:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149cc00/0xe3dac0c99affe8fe lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841818.179573:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695042944 00000100:00100000:1.0:1787841818.179585:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695042944 00000100:00100000:1.0:1787841818.179643:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 90 00000100:00100000:1.0:1787841818.179653:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf04c70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2767a54-6703-4908-8414-eab6601e2ceb+26:10003:x1874687695042944:12345-192.168.201.1@tcp:101:bash.0 00010000:00010000:1.0:1787841818.179677:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841818.179686:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841818.179728:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affe905 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d68de expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841818.179898:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affe905 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d68de expref: 27 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841818.179914:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affe905 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d68de expref: 27 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841818.179934:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92cbc3b04c00) 00010000:00010000:2.0:1787841818.179937:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787841818.179940:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cc00d9de00, rc 0) 00000100:00100000:2.0:1787841818.180034:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf04c70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2767a54-6703-4908-8414-eab6601e2ceb+27:10003:x1874687695042944:12345-192.168.201.1@tcp:101:bash.0 Request processed in 382us (3796us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841818.180042:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 90 00000100:00100000:1.0:1787841818.183370:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841818.184311:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695043072 00000100:00100000:2.0:1787841818.184322:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695043072 00000100:00100000:2.0:1787841818.184427:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 34 00000100:00100000:2.0:1787841818.184437:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff42c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b2767a54-6703-4908-8414-eab6601e2ceb+6:10003:x1874687695043072:12345-192.168.201.1@tcp:101:bash.0 00010000:00010000:2.0:1787841818.184456:0:6686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841818.184475:0:6686:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008db123e9/0xe3dac0c99affe90c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d68e5 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787841818.184513:0:6686:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a904d18, atime: 0x6a904d16, ctime: 0x6a904d18, blocks: 0xb 00010000:00010000:2.0:1787841818.184536:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=358s v=(0 0) 00010000:00010000:2.0:1787841818.184541:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787841818.184549:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008db123e9/0xe3dac0c99affe90c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d68e5 expref: 7 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841818.184566:0:6686:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008db123e9/0xe3dac0c99affe90c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d68e5 expref: 7 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841818.184578:0:6686:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc6598c00, rc 0) 00000100:00100000:2.0:1787841818.184636:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff42c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b2767a54-6703-4908-8414-eab6601e2ceb+7:10003:x1874687695043072:12345-192.168.201.1@tcp:101:bash.0 Request processed in 201us (1278us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841818.184643:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 34 00000100:00080000:1.0:1787841818.185795:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787841818.188225:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841818.195657:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695043200 00000100:00100000:0.0:1787841818.195679:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695043200 00002000:00010000:0.0:1787841818.195763:0:6692:0:(ofd_dev.c:2831:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:0.0:1787841818.195769:0:6692:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff92cbf6e2cb40 with x1874687695043200 ext(0->18446744073709551615) 00002000:00010000:0.0:1787841818.195782:0:6692:0:(ofd_dev.c:2836:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92cbf6e2cb40. 00000100:00100000:0.0:1787841818.195823:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 1 00000100:00100000:0.0:1787841818.195834:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e2cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b2767a54-6703-4908-8414-eab6601e2ceb+7:2355:x1874687695043200:12345-192.168.201.1@tcp:10:bash.0 00002000:00010000:0.0:1787841818.196112:0:6692:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1787841818.196116:0:6692:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1787841816 -> 1787841818 00002000:00010000:0.0:1787841818.196118:0:6692:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1787841814 -> 1787841814 00002000:00010000:0.0:1787841818.196120:0:6692:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787841816 -> 1787841818 00002000:00010000:0.0:1787841818.196123:0:6692:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1787841818.196208:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e2cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b2767a54-6703-4908-8414-eab6601e2ceb+8:2355:x1874687695043200:12345-192.168.201.1@tcp:10:bash.0 Request processed in 374us (7993us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1787841818.196218:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 1 00002000:00010000:0.0:1787841818.196223:0:6692:0:(ofd_dev.c:2831:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:0.0:1787841818.196225:0:6692:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff92cbf6e2cb40 with x1874687695043200 ext(0->18446744073709551615) 00002000:00010000:0.0:1787841818.196229:0:6692:0:(ofd_dev.c:2836:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92cbf6e2cb40. 00000100:00100000:2.0:1787841818.380866:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841818.381503:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695043328 00000100:00100000:0.0:1787841818.381515:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695043328 00000100:00100000:0.0:1787841818.381586:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 91 00000100:00100000:0.0:1787841818.381597:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cc00ddcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+27:10489:x1874687695043328:12345-192.168.201.1@tcp:34:lfs.0 00010000:00010000:0.0:1787841818.381687:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a200/0xe3dac0c99affe913 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841818.381788:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a200/0xe3dac0c99affe913 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841818.381803:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a200/0xe3dac0c99affe913 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841818.381822:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a600/0xe3dac0c99affe91a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841818.381829:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a600/0xe3dac0c99affe91a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841818.381835:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a600/0xe3dac0c99affe91a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841818.382132:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a800/0xe3dac0c99affe921 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841818.382142:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a800/0xe3dac0c99affe921 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841818.382149:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a800/0xe3dac0c99affe921 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787841818.382191:0:9449:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a800/0xe3dac0c99affe921 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841818.382203:0:9449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a200/0xe3dac0c99affe913 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841818.382211:0:9449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a200/0xe3dac0c99affe913 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841818.382227:0:9449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a200/0xe3dac0c99affe913 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841818.382233:0:9449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbffa3a200 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:0.0:1787841818.382237:0:9449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a200/0xe3dac0c99affe913 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841818.382244:0:9449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a200/0xe3dac0c99affe913 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841818.382255:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92cbd1fc7300) 00010000:00010000:0.0:1787841818.382259:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841818.382265:0:9449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a200/0xe3dac0c99affe913 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841818.382271:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a200/0xe3dac0c99affe913 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841818.382283:0:9449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a600/0xe3dac0c99affe91a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841818.382288:0:9449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a600/0xe3dac0c99affe91a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841818.382293:0:9449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a600/0xe3dac0c99affe91a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841818.382297:0:9449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbffa3a600 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:0.0:1787841818.382300:0:9449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a600/0xe3dac0c99affe91a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841818.382315:0:9449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a600/0xe3dac0c99affe91a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841818.382323:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff92cbc57e3600) 00010000:00010000:0.0:1787841818.382325:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841818.382329:0:9449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a600/0xe3dac0c99affe91a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841818.382334:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a600/0xe3dac0c99affe91a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841818.382347:0:9449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a800/0xe3dac0c99affe921 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841818.382353:0:9449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a800/0xe3dac0c99affe921 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841818.382358:0:9449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a800/0xe3dac0c99affe921 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841818.382363:0:9449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbffa3a800 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:0.0:1787841818.382366:0:9449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a800/0xe3dac0c99affe921 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841818.382371:0:9449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a800/0xe3dac0c99affe921 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841818.382378:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92cbc3b04c00) 00010000:00010000:0.0:1787841818.382380:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841818.382383:0:9449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a800/0xe3dac0c99affe921 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841818.382398:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a800/0xe3dac0c99affe921 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841818.382489:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cc00ddcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+27:10489:x1874687695043328:12345-192.168.201.1@tcp:34:lfs.0 Request processed in 893us (1631us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841818.382498:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 91 00000100:00100000:1.0:1787841818.459790:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841818.460481:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695043584 00000100:00100000:2.0:1787841818.460507:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695043584 00000100:00100000:2.0:1787841818.460576:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 92 00000100:00100000:2.0:1787841818.460588:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff42d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2767a54-6703-4908-8414-eab6601e2ceb+27:10492:x1874687695043584:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:2.0:1787841818.460613:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841818.460636:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599800/0xe3dac0c99affe928 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d68ec expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841818.460743:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599000/0xe3dac0c99affe92f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841818.460760:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599000/0xe3dac0c99affe92f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841818.460772:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599000/0xe3dac0c99affe92f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841818.460788:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599a00/0xe3dac0c99affe936 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841818.460795:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599a00/0xe3dac0c99affe936 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841818.460800:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599a00/0xe3dac0c99affe936 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841818.461126:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598200/0xe3dac0c99affe93d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841818.461137:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598200/0xe3dac0c99affe93d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841818.461145:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598200/0xe3dac0c99affe93d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787841818.461172:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1787841818.461289:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599000/0xe3dac0c99affe92f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841818.461297:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599000/0xe3dac0c99affe92f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841818.461303:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599000/0xe3dac0c99affe92f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841818.461310:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6599000 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:2.0:1787841818.461314:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599000/0xe3dac0c99affe92f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841818.461321:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599000/0xe3dac0c99affe92f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841818.461334:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92cbd1fc7300) 00010000:00010000:2.0:1787841818.461337:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787841818.461342:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599000/0xe3dac0c99affe92f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841818.461349:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599000/0xe3dac0c99affe92f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841818.461361:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599a00/0xe3dac0c99affe936 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841818.461368:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599a00/0xe3dac0c99affe936 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841818.461384:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599a00/0xe3dac0c99affe936 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841818.461389:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6599a00 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:2.0:1787841818.461392:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599a00/0xe3dac0c99affe936 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841818.461399:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599a00/0xe3dac0c99affe936 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841818.461407:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff92cbc3b04900) 00010000:00010000:2.0:1787841818.461409:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787841818.461412:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599a00/0xe3dac0c99affe936 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841818.461417:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599a00/0xe3dac0c99affe936 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841818.461459:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6599800/0xe3dac0c99affe928 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d68ec expref: 30 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841818.461472:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598200/0xe3dac0c99affe93d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d68ec expref: 29 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841818.461479:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92cbc3b04c00) 00010000:00010000:2.0:1787841818.461482:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787841818.461484:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc6598200, rc 0) 00000100:00100000:2.0:1787841818.461566:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff42d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2767a54-6703-4908-8414-eab6601e2ceb+29:10492:x1874687695043584:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 981us (1788us total) trans 4294967370 rc 0/0 00000100:00100000:2.0:1787841818.461584:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 92 00000100:00100000:2.0:1787841818.465603:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841818.465744:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695043712 00000100:00100000:0.0:1787841818.465754:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695043712 00000100:00100000:0.0:1787841818.465813:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 93 00000100:00100000:0.0:1787841818.465823:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cc00ddf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+29:10492:x1874687695043712:12345-192.168.201.1@tcp:54:lfs.0 00010000:00010000:0.0:1787841818.465889:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a600/0xe3dac0c99affe94b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841818.465908:0:9449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598e00/0xe3dac0c99affe8f0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d68d7 expref: 29 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841818.465918:0:9449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a600/0xe3dac0c99affe94b lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841818.465953:0:9449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598e00/0xe3dac0c99affe8f0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d68d7 expref: 29 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841818.465966:0:9449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598e00/0xe3dac0c99affe8f0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d68d7 expref: 29 pid: 5837 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841818.465994:0:9449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf07fa940 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9449:1874687714988544:192.168.201.1@tcp:104: 00000100:00100000:0.0:1787841818.466091:0:9449:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc3896300 going to sleep for 11 seconds 00000100:00100000:0.0:1787841818.471995:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841818.472065:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695043968 00000100:00100000:1.0:1787841818.472075:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695043968 00000100:00100000:2.0:1787841818.472101:0:9449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf07fa940 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9449:1874687714988544:192.168.201.1@tcp:104: 00010000:00010000:2.0:1787841818.472126:0:9449:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a600/0xe3dac0c99affe94b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841818.472139:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 22 00000100:00100000:1.0:1787841818.472149:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf07f83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b2767a54-6703-4908-8414-eab6601e2ceb+30:5605:x1874687695043968:12345-192.168.201.1@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787841818.472515:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf07f83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b2767a54-6703-4908-8414-eab6601e2ceb+31:5605:x1874687695043968:12345-192.168.201.1@tcp:35:ldlm_bl.0 Request processed in 365us (531us total) trans 4294967371 rc 0/0 00000100:00100000:1.0:1787841818.472523:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 22 00000100:00100000:1.0:1787841818.477858:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841818.479558:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695044096 00000100:00100000:3.0:1787841818.479574:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695044096 00010000:00010000:3.0:1787841818.479629:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598e00/0xe3dac0c99affe8f0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d68d7 expref: 31 pid: 5837 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841818.479783:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 48 00000100:00100000:3.0:1787841818.479794:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff42da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b2767a54-6703-4908-8414-eab6601e2ceb+31:2356:x1874687695044096:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787841818.479825:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787841818.479832:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598e00/0xe3dac0c99affe8f0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d68d7 expref: 31 pid: 5837 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841818.479846:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598e00/0xe3dac0c99affe8f0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d68d7 expref: 31 pid: 5837 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841818.479869:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598e00/0xe3dac0c99affe8f0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d68d7 expref: 31 pid: 5837 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841818.479897:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92cbc3b04c00) 00010000:00010000:3.0:1787841818.479903:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a600/0xe3dac0c99affe94b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841818.479913:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a600/0xe3dac0c99affe94b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841818.479921:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a600/0xe3dac0c99affe94b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841818.479954:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787841818.480016:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff42da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b2767a54-6703-4908-8414-eab6601e2ceb+30:2356:x1874687695044096:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 223us (2173us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841818.480023:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 48 00010000:00010000:2.0:1787841818.480834:0:9449:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a600/0xe3dac0c99affe94b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841818.480846:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a600/0xe3dac0c99affe94b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841818.480884:0:9449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a600/0xe3dac0c99affe94b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841818.480892:0:9449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a600/0xe3dac0c99affe94b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841818.480898:0:9449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a600/0xe3dac0c99affe94b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841818.480904:0:9449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbffa3a600 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:2.0:1787841818.480908:0:9449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a600/0xe3dac0c99affe94b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841818.480917:0:9449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a600/0xe3dac0c99affe94b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841818.480931:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92cbc3b04c00) 00010000:00010000:2.0:1787841818.480934:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787841818.480950:0:9449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a600/0xe3dac0c99affe94b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841818.480957:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a600/0xe3dac0c99affe94b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841818.481043:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cc00ddf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+29:10492:x1874687695043712:12345-192.168.201.1@tcp:54:lfs.0 Request processed in 15219us (15447us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841818.481052:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 93 00000100:00100000:1.0:1787841818.493797:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841818.493874:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695044352 00000100:00100000:3.0:1787841818.493893:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695044352 00000100:00100000:3.0:1787841818.493948:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 23 00000100:00100000:3.0:1787841818.493957:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff42e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b2767a54-6703-4908-8414-eab6601e2ceb+29:10492:x1874687695044352:12345-192.168.201.1@tcp:35:lfs.0 00000100:00100000:3.0:1787841818.494220:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff42e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b2767a54-6703-4908-8414-eab6601e2ceb+30:10492:x1874687695044352:12345-192.168.201.1@tcp:35:lfs.0 Request processed in 263us (431us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1787841818.494228:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 23 00000100:00100000:1.0:1787841818.629582:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841818.629683:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695044608 00000100:00100000:0.0:1787841818.629722:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695044608 00000100:00100000:0.0:1787841818.629795:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 94 00000100:00100000:0.0:1787841818.629805:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff42cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+30:10503:x1874687695044608:12345-192.168.201.1@tcp:101:cat.0 00010000:00010000:0.0:1787841818.629832:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841818.629852:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3bc00/0xe3dac0c99affe952 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d68f3 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841818.629929:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99affe959 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841818.629944:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99affe959 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841818.629957:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99affe959 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841818.629971:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a400/0xe3dac0c99affe960 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841818.629978:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a400/0xe3dac0c99affe960 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841818.629985:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a400/0xe3dac0c99affe960 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841818.630314:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3ae00/0xe3dac0c99affe967 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841818.630325:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3ae00/0xe3dac0c99affe967 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841818.630345:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3ae00/0xe3dac0c99affe967 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787841818.630355:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:0.0:1787841818.630451:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99affe959 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841818.630458:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99affe959 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841818.630464:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99affe959 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841818.630469:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbffa3be00 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:0.0:1787841818.630473:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99affe959 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841818.630480:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99affe959 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841818.630492:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92cbd1fc7300) 00010000:00010000:0.0:1787841818.630495:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841818.630500:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99affe959 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841818.630507:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99affe959 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841818.630521:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a400/0xe3dac0c99affe960 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841818.630526:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a400/0xe3dac0c99affe960 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841818.630539:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a400/0xe3dac0c99affe960 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841818.630544:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbffa3a400 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:0.0:1787841818.630547:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a400/0xe3dac0c99affe960 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841818.630553:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a400/0xe3dac0c99affe960 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841818.630562:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff92cbc57e3600) 00010000:00010000:0.0:1787841818.630565:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841818.630568:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a400/0xe3dac0c99affe960 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841818.630573:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a400/0xe3dac0c99affe960 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841818.630622:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3bc00/0xe3dac0c99affe952 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d68f3 expref: 33 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841818.630637:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3ae00/0xe3dac0c99affe967 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d68f3 expref: 32 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841818.630644:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92cbc3b04c00) 00010000:00010000:0.0:1787841818.630646:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787841818.630649:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbffa3ae00, rc 0) 00000100:00100000:0.0:1787841818.630789:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff42cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+32:10503:x1874687695044608:12345-192.168.201.1@tcp:101:cat.0 Request processed in 985us (1217us total) trans 4294967373 rc 0/0 00000100:00100000:0.0:1787841818.630805:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 94 00000100:00100000:0.0:1787841818.637681:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841818.637790:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695044864 00000100:00100000:3.0:1787841818.637802:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695044864 00000100:00100000:3.0:1787841818.637868:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 24 00000100:00100000:3.0:1787841818.637879:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf07fbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b2767a54-6703-4908-8414-eab6601e2ceb+32:10503:x1874687695044864:12345-192.168.201.1@tcp:35:cat.0 00000100:00100000:3.0:1787841818.638154:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf07fbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b2767a54-6703-4908-8414-eab6601e2ceb+33:10503:x1874687695044864:12345-192.168.201.1@tcp:35:cat.0 Request processed in 276us (481us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1787841818.638162:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 24 00000100:00100000:1.0:1787841818.659324:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841818.660075:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695045120 00000100:00100000:3.0:1787841818.660093:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695045120 00000100:00100000:3.0:1787841818.660415:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 95 00000100:00100000:3.0:1787841818.660436:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff42f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+33:10504:x1874687695045120:12345-192.168.201.1@tcp:36:rm.0 00010000:00010000:3.0:1787841818.660532:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787841818.660570:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3ae00/0xe3dac0c99affe967 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d68f3 expref: 33 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841818.660596:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6598200/0xe3dac0c99affe93d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d68ec expref: 32 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841818.660612:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affe905 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d68de expref: 31 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841818.660623:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92cbc3b04c00) 00010000:00010000:3.0:1787841818.660637:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787841818.660720:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149cc00/0xe3dac0c99affe975 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841818.660737:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149cc00/0xe3dac0c99affe975 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841818.660750:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149cc00/0xe3dac0c99affe975 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841818.660812:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affe97c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841818.660821:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affe97c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841818.660828:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affe97c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841818.661281:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affe983 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841818.661291:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affe983 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841818.661299:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affe983 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787841818.662182:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:3.0:1787841818.662200:0:5839:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 358660500945ns, next at 359660496035ns, rc = 0 00010000:00010000:3.0:1787841818.662289:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affe98a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841818.662302:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affe98a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841818.662318:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affe98a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841818.662328:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affe98a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841818.662336:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affe98a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841818.662342:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affe98a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841818.662380:0:5839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787841818.662419:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affe983 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841818.662426:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affe983 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841818.662433:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affe983 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841818.662441:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc149c400 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:3.0:1787841818.662446:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affe983 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841818.662455:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affe983 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841818.662468:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92cbc89cd000) 00010000:00010000:3.0:1787841818.662472:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787841818.662484:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affe983 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841818.662491:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affe983 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841818.662517:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149cc00/0xe3dac0c99affe975 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841818.662524:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149cc00/0xe3dac0c99affe975 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841818.662531:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149cc00/0xe3dac0c99affe975 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841818.662536:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc149cc00 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:3.0:1787841818.662539:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149cc00/0xe3dac0c99affe975 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841818.662545:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149cc00/0xe3dac0c99affe975 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841818.662554:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92cbd1fc7300) 00010000:00010000:3.0:1787841818.662556:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787841818.662560:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149cc00/0xe3dac0c99affe975 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841818.662566:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149cc00/0xe3dac0c99affe975 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787841818.662576:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004b2d6f87 reply state 0000000012308b7a transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affe97c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841818.662597:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787841818.662785:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff42f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+32:10504:x1874687695045120:12345-192.168.201.1@tcp:36:rm.0 Request processed in 2349us (3480us total) trans 4294967375 rc 0/0 00000100:00100000:3.0:1787841818.662796:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 95 00010000:00010000:2.0:1787841818.662895:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787841818.662904:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affe98a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841818.662911:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc149d600 already unused, calling callback (ffffffffc17a4500) 00010000:00010000:2.0:1787841818.662916:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affe98a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841818.662922:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affe98a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841818.662933:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92cbc89cd000) 00010000:00010000:2.0:1787841818.662936:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787841818.662939:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affe98a lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841818.662944:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affe98a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841818.662965:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841818.662967:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841818.662968:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841818.670652:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affe97c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841818.670681:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affe97c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841818.670742:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affe97c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841818.670750:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc149d400 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:3.0:1787841818.670756:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affe97c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841818.670765:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affe97c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841818.670799:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff92cbc89cdb00) 00010000:00010000:3.0:1787841818.670803:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787841818.670810:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affe97c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841818.670818:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affe97c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841818.761163:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841818.761519:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695045376 00000100:00100000:2.0:1787841818.761545:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695045376 00000100:00100000:2.0:1787841818.761620:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 96 00000100:00100000:2.0:1787841818.761631:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff42f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2767a54-6703-4908-8414-eab6601e2ceb+31:10510:x1874687695045376:12345-192.168.201.1@tcp:101:bash.0 00010000:00010000:2.0:1787841818.761662:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841818.761686:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104600/0xe3dac0c99affe991 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d68fa expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841818.762086:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104400/0xe3dac0c99affe998 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841818.762103:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104400/0xe3dac0c99affe998 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841818.762116:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104400/0xe3dac0c99affe998 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841818.762131:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105e00/0xe3dac0c99affe99f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841818.762138:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105e00/0xe3dac0c99affe99f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841818.762144:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105e00/0xe3dac0c99affe99f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787841818.765131:0:5838:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:2.0:1787841818.768117:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105400/0xe3dac0c99affe9a6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841818.769058:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105400/0xe3dac0c99affe9a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841818.769435:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105400/0xe3dac0c99affe9a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841818.769493:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104400/0xe3dac0c99affe998 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841818.769502:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104400/0xe3dac0c99affe998 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841818.769509:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104400/0xe3dac0c99affe998 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841818.769515:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6104400 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:2.0:1787841818.769519:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104400/0xe3dac0c99affe998 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841818.769527:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104400/0xe3dac0c99affe998 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841818.769541:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92cbd1fc7300) 00010000:00010000:2.0:1787841818.769544:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787841818.769550:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104400/0xe3dac0c99affe998 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841818.769557:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104400/0xe3dac0c99affe998 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787841818.769573:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e1dda0e6 reply state 000000009f163650 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105e00/0xe3dac0c99affe99f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841818.769583:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787841818.769631:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104600/0xe3dac0c99affe991 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d68fa expref: 34 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841818.769647:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105400/0xe3dac0c99affe9a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d68fa expref: 33 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841818.769655:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92cbc3b04400) 00010000:00010000:2.0:1787841818.769657:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787841818.769660:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc6105400, rc 0) 00000100:00100000:2.0:1787841818.771676:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff42f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2767a54-6703-4908-8414-eab6601e2ceb+34:10510:x1874687695045376:12345-192.168.201.1@tcp:101:bash.0 Request processed in 10035us (10512us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1787841818.771861:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 96 00010000:00010000:3.0:1787841818.773978:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105e00/0xe3dac0c99affe99f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841818.774013:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105e00/0xe3dac0c99affe99f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841818.774021:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105e00/0xe3dac0c99affe99f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841818.774028:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6105e00 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:3.0:1787841818.774032:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105e00/0xe3dac0c99affe99f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841818.774040:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105e00/0xe3dac0c99affe99f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841818.774056:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff92cbc3b04900) 00010000:00010000:3.0:1787841818.774060:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787841818.774065:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105e00/0xe3dac0c99affe99f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841818.774071:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105e00/0xe3dac0c99affe99f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841818.790629:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841818.790743:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695045504 00000100:00100000:0.0:1787841818.790754:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695045504 00000100:00100000:0.0:1787841818.790827:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 35 00000100:00100000:0.0:1787841818.790837:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff42de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b2767a54-6703-4908-8414-eab6601e2ceb+5:2356:x1874687695045504:12345-192.168.201.1@tcp:101:bash.0 00010000:00010000:0.0:1787841818.790858:0:6687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841818.790881:0:6687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000070798621/0xe3dac0c99affe9b4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6901 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787841818.790917:0:6687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787841818.790941:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=358s v=(0 0) 00010000:00010000:0.0:1787841818.790945:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787841818.790957:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070798621/0xe3dac0c99affe9b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6901 expref: 6 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841818.790977:0:6687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000070798621/0xe3dac0c99affe9b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6901 expref: 6 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841818.790991:0:6687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbffa3bc00, rc 0) 00000100:00100000:0.0:1787841818.791063:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff42de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b2767a54-6703-4908-8414-eab6601e2ceb+6:2356:x1874687695045504:12345-192.168.201.1@tcp:101:bash.0 Request processed in 227us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841818.791071:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 35 00000100:00100000:2.0:1787841818.806031:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841818.810426:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695045632 00000100:00100000:1.0:1787841818.810443:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695045632 00000100:00100000:1.0:1787841818.810958:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 36 00000100:00100000:1.0:1787841818.810970:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cc00ddf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b2767a54-6703-4908-8414-eab6601e2ceb+6:10510:x1874687695045632:12345-192.168.201.1@tcp:101:bash.0 00010000:00010000:1.0:1787841818.810991:0:6686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841818.811011:0:6686:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000060899752/0xe3dac0c99affe9bb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6908 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841818.811050:0:6686:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000070798621/0xe3dac0c99affe9b4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6901 expref: 7 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841818.811060:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787841818.811064:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787841818.811070:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060899752/0xe3dac0c99affe9bb lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6908 expref: 7 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841818.811131:0:6686:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000070798621/0xe3dac0c99affe9b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6901 expref: 7 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841818.811147:0:6686:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000070798621/0xe3dac0c99affe9b4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6901 expref: 7 pid: 6687 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841818.811162:0:6686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff42c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6686:1874687714988672:192.168.201.1@tcp:104: 00000100:00100000:1.0:1787841818.811278:0:6686:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cac3324000 going to sleep for 11 seconds 00000100:00100000:2.0:1787841818.817437:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841818.817795:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695045760 00000100:00100000:3.0:1787841818.817806:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695045760 00010000:00010000:3.0:1787841818.817854:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000070798621/0xe3dac0c99affe9b4 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6901 expref: 8 pid: 6687 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841818.817907:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 49 00000100:00100000:3.0:1787841818.817919:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcdb79450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b2767a54-6703-4908-8414-eab6601e2ceb+8:2357:x1874687695045760:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787841818.817940:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787841818.817996:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000070798621/0xe3dac0c99affe9b4 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6901 expref: 8 pid: 6687 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841818.818013:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000070798621/0xe3dac0c99affe9b4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6901 expref: 8 pid: 6687 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841818.818042:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787841818.818047:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787841818.818059:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000060899752/0xe3dac0c99affe9bb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6908 expref: 8 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841818.818071:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060899752/0xe3dac0c99affe9bb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6908 expref: 8 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841818.818380:0:5823:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000060899752/0xe3dac0c99affe9bb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6908 expref: 8 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841818.818398:0:5823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e2fc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5823:1874687714988800:192.168.201.1@tcp:105: 00000100:00100000:3.0:1787841818.818570:0:5823:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbf046fa80 going to sleep for 11 seconds 00010000:00010000:1.0:1787841818.820339:0:6686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000070798621/0xe3dac0c99affe9b4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6901 expref: 8 pid: 6687 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841818.820367:0:6686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff42c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6686:1874687714988672:192.168.201.1@tcp:104: 00010000:00010000:1.0:1787841818.820405:0:6686:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000060899752/0xe3dac0c99affe9bb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6908 expref: 7 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841818.820420:0:6686:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cc00d9d000, rc 0) 00000100:00100000:1.0:1787841818.820497:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cc00ddf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b2767a54-6703-4908-8414-eab6601e2ceb+7:10510:x1874687695045632:12345-192.168.201.1@tcp:101:bash.0 Request processed in 9529us (14481us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841818.820509:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 36 00000100:00100000:3.0:1787841818.827899:0:5823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e2fc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5823:1874687714988800:192.168.201.1@tcp:105: 00010000:00010000:3.0:1787841818.827934:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787841818.828023:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcdb79450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b2767a54-6703-4908-8414-eab6601e2ceb+6:2357:x1874687695045760:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 10107us (10596us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841818.828037:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 49 00000100:00100000:3.0:1787841818.832023:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841818.833008:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695046016 00000100:00100000:1.0:1787841818.833032:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695046016 00000100:00100000:2.0:1787841818.834121:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 25 00000100:00100000:2.0:1787841818.834158:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e2d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b2767a54-6703-4908-8414-eab6601e2ceb+33:10510:x1874687695046016:12345-192.168.201.1@tcp:35:bash.0 00000100:00100000:2.0:1787841818.834772:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e2d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b2767a54-6703-4908-8414-eab6601e2ceb+34:10510:x1874687695046016:12345-192.168.201.1@tcp:35:bash.0 Request processed in 626us (2762us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1787841818.834782:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 25 00000100:00100000:2.0:1787841819.093620:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841819.093741:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695046144 00000100:00100000:0.0:1787841819.093755:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695046144 00000100:00100000:0.0:1787841819.093870:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 97 00000100:00100000:0.0:1787841819.093904:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cc00ddde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+34:10527:x1874687695046144:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:0.0:1787841819.093945:0:9449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841819.093977:0:9449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a400/0xe3dac0c99affe9c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d690f expref: -99 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841819.094083:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99affe9c9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841819.094105:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99affe9c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841819.094121:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99affe9c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787841819.094208:0:9449:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:0.0:1787841819.094212:0:9449:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787841819.094241:0:9449:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99affe9c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841819.094273:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a400/0xe3dac0c99affe9c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d690f expref: 36 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841819.094297:0:9449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99affe9c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d690f expref: 35 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841819.094307:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92cbd1fc7300) 00010000:00010000:0.0:1787841819.094321:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787841819.094327:0:9449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbffa3be00, rc 0) 00000100:00100000:0.0:1787841819.094415:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cc00ddde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+35:10527:x1874687695046144:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 515us (810us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841819.094446:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 97 00000100:00080000:1.0:1787841819.094549:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787841819.118041:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841819.118899:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695046400 00000100:00100000:0.0:1787841819.118913:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695046400 00000100:00100000:0.0:1787841819.118993:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 98 00000100:00100000:0.0:1787841819.119007:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff42c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+35:10527:x1874687695046400:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:0.0:1787841819.119039:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841819.119069:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a400/0xe3dac0c99affe9d0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6916 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841819.119217:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b200/0xe3dac0c99affe9d7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841819.119234:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b200/0xe3dac0c99affe9d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841819.119249:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b200/0xe3dac0c99affe9d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787841819.119264:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1787841819.119967:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a400/0xe3dac0c99affe9d0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6916 expref: 38 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841819.119994:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b200/0xe3dac0c99affe9d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6916 expref: 37 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841819.120004:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92cbc3b04400) 00010000:00010000:0.0:1787841819.120007:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787841819.120012:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbffa3b200, rc 0) 00000100:00100000:1.0:1787841819.126123:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff42c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+37:10527:x1874687695046400:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 7101us (8078us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1787841819.126141:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 98 00000100:00100000:3.0:1787841819.135300:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841819.135978:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695046656 00000100:00100000:0.0:1787841819.135993:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695046656 00000100:00100000:0.0:1787841819.136079:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 99 00000100:00100000:0.0:1787841819.136092:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e2fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+37:10527:x1874687695046656:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:0.0:1787841819.136127:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841819.136158:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a400/0xe3dac0c99affe9e5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d691d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841819.136294:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b400/0xe3dac0c99affe9ec lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841819.136318:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b400/0xe3dac0c99affe9ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841819.136333:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b400/0xe3dac0c99affe9ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787841819.136363:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1787841819.137839:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a400/0xe3dac0c99affe9e5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d691d expref: 40 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841819.137872:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b400/0xe3dac0c99affe9ec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d691d expref: 39 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841819.137883:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92cbc3b04400) 00010000:00010000:0.0:1787841819.137886:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787841819.137890:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbffa3b400, rc 0) 00000100:00100000:0.0:1787841819.138042:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e2fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+39:10527:x1874687695046656:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 1951us (2754us total) trans 4294967379 rc 0/0 00000100:00100000:0.0:1787841819.138079:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 99 00000100:00100000:2.0:1787841819.152254:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841819.152491:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695046784 00000100:00100000:0.0:1787841819.152505:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695046784 00000100:00100000:0.0:1787841819.152597:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 6 00000100:00100000:0.0:1787841819.152610:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cc00ddc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b2767a54-6703-4908-8414-eab6601e2ceb+39:2357:x1874687695046784:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787841819.152629:0:7632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787841819.152673:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b200/0xe3dac0c99affe9d7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6916 expref: 39 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841819.152739:0:7632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92cbc3b04400) 00010000:00010000:0.0:1787841819.152746:0:7632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787841819.152820:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cc00ddc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b2767a54-6703-4908-8414-eab6601e2ceb+38:2357:x1874687695046784:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 211us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841819.152828:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 6 00000100:00100000:1.0:1787841819.162279:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841819.162788:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695046912 00000100:00100000:0.0:1787841819.162803:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695046912 00000100:00100000:0.0:1787841819.162907:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 37 00000100:00100000:0.0:1787841819.162919:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff42f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b2767a54-6703-4908-8414-eab6601e2ceb+6:2357:x1874687695046912:12345-192.168.201.1@tcp:1:lfs.0 00010000:00010000:0.0:1787841819.162987:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096c683fd/0xe3dac0c99affe9fa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841819.163018:0:6687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000060899752/0xe3dac0c99affe9bb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6908 expref: 6 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841819.163029:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1787841819.163036:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787841819.163064:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096c683fd/0xe3dac0c99affe9fa lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841819.163117:0:6687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000060899752/0xe3dac0c99affe9bb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6908 expref: 6 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841819.163135:0:6687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000060899752/0xe3dac0c99affe9bb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6908 expref: 6 pid: 6686 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841819.163154:0:6687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf07f9e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6687:1874687714988928:192.168.201.1@tcp:104: 00000100:00100000:0.0:1787841819.163291:0:6687:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc3896300 going to sleep for 11 seconds 00000100:00080000:1.0:1787841819.164026:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787841819.167739:0:6687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf07f9e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6687:1874687714988928:192.168.201.1@tcp:104: 00010000:00010000:3.0:1787841819.167795:0:6687:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000096c683fd/0xe3dac0c99affe9fa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841819.178773:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841819.178909:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695047040 00000100:00100000:3.0:1787841819.178923:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695047040 00002000:00100000:3.0:1787841819.179003:0:6693:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff92cc00ddf0c0 x1874687695047040/t0(0) o4->b2767a54-6703-4908-8414-eab6601e2ceb@192.168.201.1@tcp:320/0 lens 504/0 e 0 to 0 dl 1787841830 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787841819.179019:0:6693:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff92cc00ddf0c0 with x1874687695047040 ext(0->8) 00010000:00010000:3.0:1787841819.179033:0:6693:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000060899752/0xe3dac0c99affe9bb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6908 expref: 7 pid: 6686 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841819.179056:0:6693:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000060899752/0xe3dac0c99affe9bb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6908 expref: 7 pid: 6686 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787841819.179066:0:6693:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92cc00ddf0c0 00000100:00100000:3.0:1787841819.179110:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 1 00000100:00100000:3.0:1787841819.179123:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cc00ddf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b2767a54-6703-4908-8414-eab6601e2ceb+7:2356:x1874687695047040:12345-192.168.201.1@tcp:4:lfs.0 00000100:00100000:3.0:1787841819.184280:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cc00ddf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b2767a54-6703-4908-8414-eab6601e2ceb+9:2356:x1874687695047040:12345-192.168.201.1@tcp:4:lfs.0 Request processed in 5147us (5518us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1787841819.184297:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 1 00002000:00100000:3.0:1787841819.184308:0:6693:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff92cc00ddf0c0 x1874687695047040/t4294967302(0) o4->b2767a54-6703-4908-8414-eab6601e2ceb@192.168.201.1@tcp:320/0 lens 504/448 e 0 to 0 dl 1787841830 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787841819.184320:0:6693:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff92cc00ddf0c0 with x1874687695047040 ext(0->8) 00010000:00010000:3.0:1787841819.184333:0:6693:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000060899752/0xe3dac0c99affe9bb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6908 expref: 9 pid: 6686 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841819.184363:0:6693:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000060899752/0xe3dac0c99affe9bb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6908 expref: 9 pid: 6686 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787841819.184371:0:6693:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92cc00ddf0c0 00000100:00100000:3.0:1787841819.192089:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841819.192188:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695047168 00000100:00100000:0.0:1787841819.192210:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695047168 00010000:00010000:0.0:1787841819.192295:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000060899752/0xe3dac0c99affe9bb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6908 expref: 9 pid: 6686 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841819.192374:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 50 00000100:00100000:0.0:1787841819.192388:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e2da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b2767a54-6703-4908-8414-eab6601e2ceb+9:2355:x1874687695047168:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787841819.192412:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787841819.192460:0:5824:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1787841819.192464:0:5824:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787841819 00002000:00010000:0.0:1787841819.192467:0:5824:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787841819 00002000:00010000:0.0:1787841819.192470:0:5824:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1787841819 00010000:00010000:0.0:1787841819.192477:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000060899752/0xe3dac0c99affe9bb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6908 expref: 9 pid: 6686 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841819.192505:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000060899752/0xe3dac0c99affe9bb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6908 expref: 9 pid: 6686 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841819.192652:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060899752/0xe3dac0c99affe9bb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6908 expref: 9 pid: 6686 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841819.192679:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787841819.192755:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787841819.193030:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000096c683fd/0xe3dac0c99affe9fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841819.193047:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096c683fd/0xe3dac0c99affe9fa lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841819.193096:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787841819.193184:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e2da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b2767a54-6703-4908-8414-eab6601e2ceb+8:2355:x1874687695047168:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 797us (1110us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841819.193193:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 50 00010000:00010000:3.0:1787841819.194761:0:6687:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000096c683fd/0xe3dac0c99affe9fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841819.194783:0:6687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000096c683fd/0xe3dac0c99affe9fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841819.194826:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096c683fd/0xe3dac0c99affe9fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841819.194834:0:6687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000096c683fd/0xe3dac0c99affe9fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841819.194843:0:6687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000096c683fd/0xe3dac0c99affe9fa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841819.194850:0:6687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbffa3a400 already unused, calling callback (ffffffffc17a4500) 00010000:00010000:3.0:1787841819.194856:0:6687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000096c683fd/0xe3dac0c99affe9fa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841819.194866:0:6687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000096c683fd/0xe3dac0c99affe9fa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841819.194925:0:6687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000096c683fd/0xe3dac0c99affe9fa lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841819.194932:0:6687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000096c683fd/0xe3dac0c99affe9fa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841819.195053:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff42f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b2767a54-6703-4908-8414-eab6601e2ceb+7:2357:x1874687695046912:12345-192.168.201.1@tcp:1:lfs.0 Request processed in 32133us (32787us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841819.195064:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 37 00000100:00100000:3.0:1787841819.202049:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00010000:00010000:2.0:1787841819.202536:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787841819.202979:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695047424 00000100:00100000:0.0:1787841819.202996:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695047424 00000100:00100000:0.0:1787841819.203093:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 26 00000100:00100000:0.0:1787841819.203106:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbc6c31050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b2767a54-6703-4908-8414-eab6601e2ceb+38:10527:x1874687695047424:12345-192.168.201.1@tcp:35:lfs.0 00000004:00010000:0.0:1787841819.203201:0:5840:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b400/0xe3dac0c99affe9ec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d691d expref: 38 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787841819.205149:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:0.0:1787841819.205247:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:0.0:1787841819.205774:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:0.0:1787841819.205847:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b200/0xe3dac0c99affea01 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841819.205889:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105400/0xe3dac0c99affe9a6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d68fa expref: 42 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841819.205901:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b200/0xe3dac0c99affea01 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841819.205954:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105400/0xe3dac0c99affe9a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d68fa expref: 42 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841819.205978:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105400/0xe3dac0c99affe9a6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d68fa expref: 42 pid: 5838 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841819.206000:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf07fb840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5840:1874687714989056:192.168.201.1@tcp:104: 00000100:00100000:0.0:1787841819.206132:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbf0462840 going to sleep for 11 seconds 00000100:00100000:1.0:1787841819.209018:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841819.209174:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695047552 00000100:00100000:2.0:1787841819.209187:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695047552 00010000:00010000:2.0:1787841819.209251:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105400/0xe3dac0c99affe9a6 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d68fa expref: 43 pid: 5838 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841819.209340:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 51 00000100:00100000:2.0:1787841819.209352:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff42e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b2767a54-6703-4908-8414-eab6601e2ceb+43:2356:x1874687695047552:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787841819.209374:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787841819.209382:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105400/0xe3dac0c99affe9a6 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d68fa expref: 43 pid: 5838 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841819.209397:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105400/0xe3dac0c99affe9a6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d68fa expref: 43 pid: 5838 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841819.209430:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92cbc3b04400) 00010000:00010000:2.0:1787841819.209437:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b200/0xe3dac0c99affea01 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841819.209449:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b200/0xe3dac0c99affea01 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841819.209458:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b200/0xe3dac0c99affea01 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841819.209493:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787841819.209572:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff42e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b2767a54-6703-4908-8414-eab6601e2ceb+43:2356:x1874687695047552:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 221us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841819.209579:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 51 00010000:00010000:3.0:1787841819.210077:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105400/0xe3dac0c99affe9a6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d68fa expref: 42 pid: 5838 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841819.210116:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf07fb840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5840:1874687714989056:192.168.201.1@tcp:104: 00010000:00010000:3.0:1787841819.210143:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b200/0xe3dac0c99affea01 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841819.210154:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b200/0xe3dac0c99affea01 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841819.210160:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b200/0xe3dac0c99affea01 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787841819.210353:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:3.0:1787841819.210622:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:3.0:1787841819.210800:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e2e1c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5840:1874687714989184:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787841819.215118:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841819.215196:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbf046f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787841819.219350:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714989184 00000100:00100000:2.0:1787841819.219374:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714989184 00000100:00100000:2.0:1787841819.219511:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787841819.219524:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e2cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5840:x1874687714989184:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787841819.219775:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e2cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5840:x1874687714989184:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 253us (4670us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841819.219784:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1787841819.220147:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787841819.220380:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e2e1c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5840:1874687714989184:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1787841819.227629:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:0.0:1787841819.227833:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf07fb840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5840:1874687714989312:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787841819.227951:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841819.228020:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbd5b9b840 going to sleep for 11 seconds 00000100:00100000:2.0:1787841819.229303:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714989312 00000100:00100000:2.0:1787841819.229319:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714989312 00000100:00100000:2.0:1787841819.229414:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787841819.229425:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf07f9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5840:x1874687714989312:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787841819.229817:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf07f9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:5840:x1874687714989312:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 393us (1866us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1787841819.229826:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787841819.230160:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf07fb840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5840:1874687714989312:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1787841819.230261:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:1.0:1787841819.230319:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b200/0xe3dac0c99affea01 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841819.230331:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b200/0xe3dac0c99affea01 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841819.230357:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b200/0xe3dac0c99affea01 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841819.230364:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbffa3b200 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:1.0:1787841819.230370:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b200/0xe3dac0c99affea01 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841819.230378:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b200/0xe3dac0c99affea01 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841819.230400:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92cbc3b04400) 00010000:00010000:1.0:1787841819.230403:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787841819.230409:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b200/0xe3dac0c99affea01 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841819.230416:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b200/0xe3dac0c99affea01 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787841819.230658:0:5840:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1787841819.230841:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:1.0:1787841819.230857:0:5840:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 359229158083ns, next at 360229155380ns, rc = 0 00000001:00080000:1.0:1787841819.230864:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:1.0:1787841819.230916:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92cbc3b04400) 00010000:00010000:1.0:1787841819.230919:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787841819.230927:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b400/0xe3dac0c99affe9ec lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d691d expref: 46 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841819.231060:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbc6c31050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b2767a54-6703-4908-8414-eab6601e2ceb+45:10527:x1874687695047424:12345-192.168.201.1@tcp:35:lfs.0 Request processed in 27956us (29020us total) trans 4294967388 rc 0/0 00000100:00100000:1.0:1787841819.231084:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 26 00000020:00080000:1.0:1787841819.231089:0:5840:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1787841819.234421:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841819.234580:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695047680 00000100:00100000:2.0:1787841819.234596:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695047680 00000100:00100000:2.0:1787841819.234693:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 100 00000100:00100000:2.0:1787841819.234728:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff42e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2767a54-6703-4908-8414-eab6601e2ceb+45:10527:x1874687695047680:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:2.0:1787841819.234951:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841819.234984:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105a00/0xe3dac0c99affea08 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6924 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841819.235075:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105a00/0xe3dac0c99affea08 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6924 expref: 46 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841819.235092:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105a00/0xe3dac0c99affea08 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6924 expref: 46 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841819.235115:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92cbc3b04b00) 00010000:00010000:2.0:1787841819.235118:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787841819.235141:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc6105a00, rc 0) 00000100:00100000:2.0:1787841819.235227:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff42e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2767a54-6703-4908-8414-eab6601e2ceb+46:10527:x1874687695047680:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 503us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841819.235235:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 100 00000100:00100000:2.0:1787841819.244227:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841819.247250:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695047936 00000100:00100000:0.0:1787841819.247282:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695047936 00000100:00100000:0.0:1787841819.247409:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 27 00000100:00100000:0.0:1787841819.247425:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cc00dde940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b2767a54-6703-4908-8414-eab6601e2ceb+46:10527:x1874687695047936:12345-192.168.201.1@tcp:35:lfs.0 00000100:00100000:2.0:1787841819.248036:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cc00dde940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b2767a54-6703-4908-8414-eab6601e2ceb+47:10527:x1874687695047936:12345-192.168.201.1@tcp:35:lfs.0 Request processed in 612us (3822us total) trans 4294967389 rc 0/0 00000100:00100000:2.0:1787841819.248046:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 27 00000100:00100000:0.0:1787841819.456282:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841819.456396:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695048064 00000100:00100000:1.0:1787841819.456411:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695048064 00000100:00100000:1.0:1787841819.456508:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 101 00000100:00100000:1.0:1787841819.456520:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf07fa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+47:10537:x1874687695048064:12345-192.168.201.1@tcp:34:lfs.0 00010000:00010000:1.0:1787841819.456640:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d200/0xe3dac0c99affea0f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841819.456670:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d200/0xe3dac0c99affea0f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841819.456722:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d200/0xe3dac0c99affea0f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841819.456746:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affea16 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841819.456764:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affea16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841819.456773:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affea16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841819.456945:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9ca00/0xe3dac0c99affea1d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841819.456955:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9ca00/0xe3dac0c99affea1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841819.456990:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9ca00/0xe3dac0c99affea1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787841819.457065:0:9449:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9ca00/0xe3dac0c99affea1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841819.457084:0:9449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d200/0xe3dac0c99affea0f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841819.457091:0:9449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d200/0xe3dac0c99affea0f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841819.457099:0:9449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d200/0xe3dac0c99affea0f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841819.457105:0:9449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cc00d9d200 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:1.0:1787841819.457110:0:9449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d200/0xe3dac0c99affea0f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841819.457117:0:9449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d200/0xe3dac0c99affea0f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841819.457131:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92cbd1fc7300) 00010000:00010000:1.0:1787841819.457135:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787841819.457140:0:9449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d200/0xe3dac0c99affea0f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841819.457146:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d200/0xe3dac0c99affea0f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841819.457159:0:9449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affea16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841819.457173:0:9449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affea16 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841819.457180:0:9449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affea16 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841819.457185:0:9449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cc00d9de00 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:1.0:1787841819.457189:0:9449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affea16 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841819.457197:0:9449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affea16 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841819.457208:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff92cbd1fc7900) 00010000:00010000:1.0:1787841819.457210:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787841819.457212:0:9449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affea16 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841819.457218:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affea16 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841819.457234:0:9449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9ca00/0xe3dac0c99affea1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841819.457240:0:9449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9ca00/0xe3dac0c99affea1d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841819.457245:0:9449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9ca00/0xe3dac0c99affea1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841819.457249:0:9449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cc00d9ca00 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:1.0:1787841819.457259:0:9449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9ca00/0xe3dac0c99affea1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841819.457266:0:9449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9ca00/0xe3dac0c99affea1d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841819.457274:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92cbc3b04b00) 00010000:00010000:1.0:1787841819.457277:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787841819.457279:0:9449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9ca00/0xe3dac0c99affea1d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841819.457285:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9ca00/0xe3dac0c99affea1d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841819.457392:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf07fa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+47:10537:x1874687695048064:12345-192.168.201.1@tcp:34:lfs.0 Request processed in 873us (1128us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841819.457402:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 101 00000001:00080000:3.0:1787841819.507858:0:7643:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00080000:3.0:1787841819.507899:0:7643:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:3.0:1787841819.507911:0:7643:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:1.0:1787841819.528562:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841819.528688:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695048320 00000100:00100000:3.0:1787841819.528742:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695048320 00000100:00100000:3.0:1787841819.528824:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 102 00000100:00100000:3.0:1787841819.528836:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff42cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+47:10540:x1874687695048320:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:3.0:1787841819.528865:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841819.528897:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149cc00/0xe3dac0c99affea24 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d692b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841819.529025:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affea2b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841819.529048:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affea2b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841819.529063:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affea2b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841819.529084:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affea32 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841819.529092:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affea32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841819.529099:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affea32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841819.529523:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affea39 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841819.529533:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affea39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841819.529541:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affea39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787841819.529552:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1787841819.529743:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affea2b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841819.529752:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affea2b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841819.529760:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affea2b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841819.529766:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc149d400 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:3.0:1787841819.529772:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affea2b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841819.529781:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affea2b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841819.529796:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92cbd1fc7300) 00010000:00010000:3.0:1787841819.529800:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787841819.529807:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affea2b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841819.529824:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affea2b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841819.529843:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affea32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841819.529850:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affea32 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841819.529856:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affea32 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841819.529861:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc149c400 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:3.0:1787841819.529865:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affea32 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841819.529871:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affea32 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841819.529880:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff92cbc89cdf00) 00010000:00010000:3.0:1787841819.529883:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787841819.529886:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affea32 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841819.529892:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affea32 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841819.529952:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149cc00/0xe3dac0c99affea24 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d692b expref: 50 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841819.529968:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affea39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d692b expref: 49 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841819.529990:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92cbc3b04b00) 00010000:00010000:3.0:1787841819.529993:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787841819.529996:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc149d600, rc 0) 00000100:00100000:3.0:1787841819.530098:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff42cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+49:10540:x1874687695048320:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 1264us (1551us total) trans 4294967390 rc 0/0 00000100:00100000:3.0:1787841819.530124:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 102 00000100:00100000:2.0:1787841819.543487:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841819.543694:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695048448 00000100:00100000:1.0:1787841819.543738:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695048448 00000100:00100000:1.0:1787841819.543827:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 103 00000100:00100000:1.0:1787841819.543841:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cc00ddcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+49:10540:x1874687695048448:12345-192.168.201.1@tcp:54:lfs.0 00010000:00010000:1.0:1787841819.543961:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9ca00/0xe3dac0c99affea47 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841819.543992:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9ca00/0xe3dac0c99affea47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841819.544012:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9ca00/0xe3dac0c99affea47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841819.544100:0:9449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9ca00/0xe3dac0c99affea47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841819.544260:0:9449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9ca00/0xe3dac0c99affea47 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841819.544280:0:9449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9ca00/0xe3dac0c99affea47 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841819.544287:0:9449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cc00d9ca00 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:1.0:1787841819.544293:0:9449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9ca00/0xe3dac0c99affea47 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841819.544303:0:9449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9ca00/0xe3dac0c99affea47 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841819.544322:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92cbc3b04b00) 00010000:00010000:1.0:1787841819.544325:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787841819.544332:0:9449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9ca00/0xe3dac0c99affea47 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841819.544339:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9ca00/0xe3dac0c99affea47 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841819.544451:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cc00ddcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+49:10540:x1874687695048448:12345-192.168.201.1@tcp:54:lfs.0 Request processed in 613us (984us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841819.544460:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 103 00000100:00100000:0.0:1787841819.550957:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841819.551049:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695048704 00000100:00100000:1.0:1787841819.551064:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695048704 00000100:00100000:1.0:1787841819.551149:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 28 00000100:00100000:1.0:1787841819.551183:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf07f83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b2767a54-6703-4908-8414-eab6601e2ceb+49:10540:x1874687695048704:12345-192.168.201.1@tcp:35:lfs.0 00000100:00100000:1.0:1787841819.551570:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf07f83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b2767a54-6703-4908-8414-eab6601e2ceb+50:10540:x1874687695048704:12345-192.168.201.1@tcp:35:lfs.0 Request processed in 388us (627us total) trans 4294967391 rc 0/0 00000100:00100000:1.0:1787841819.551580:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 28 00000100:00100000:2.0:1787841819.721006:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841819.721161:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695048960 00000100:00100000:3.0:1787841819.721175:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695048960 00000100:00100000:3.0:1787841819.721257:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 104 00000100:00100000:3.0:1787841819.721268:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cc00dde580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+50:10550:x1874687695048960:12345-192.168.201.1@tcp:101:bash.0 00010000:00010000:3.0:1787841819.721303:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841819.721307:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787841819.721343:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99affe9c9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d690f expref: 50 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841819.721369:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92cbd1fc7300) 00010000:00010000:3.0:1787841819.721376:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787841819.721393:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149cc00/0xe3dac0c99affea4e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6932 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841819.721643:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affea55 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841819.721660:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affea55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841819.721672:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affea55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787841819.721849:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1787841819.722227:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149cc00/0xe3dac0c99affea4e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6932 expref: 52 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841819.722247:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affea55 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6932 expref: 51 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841819.722256:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92cbc3b04b00) 00010000:00010000:3.0:1787841819.722259:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787841819.722262:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc149c400, rc 0) 00000100:00100000:3.0:1787841819.722404:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cc00dde580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+51:10550:x1874687695048960:12345-192.168.201.1@tcp:101:bash.0 Request processed in 1137us (1410us total) trans 4294967392 rc 0/0 00000100:00100000:3.0:1787841819.722414:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 104 00000100:00100000:3.0:1787841819.736575:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841819.737224:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695049216 00000100:00100000:0.0:1787841819.737259:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695049216 00000100:00100000:0.0:1787841819.737399:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 105 00000100:00100000:0.0:1787841819.737413:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+51:10550:x1874687695049216:12345-192.168.201.1@tcp:36:bash.0 00010000:00010000:0.0:1787841819.737728:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1787841819.737782:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affea55 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6932 expref: 51 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841819.737811:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affea39 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d692b expref: 50 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841819.737823:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92cbc3b04b00) 00010000:00010000:0.0:1787841819.737829:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787841819.738195:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3ba00/0xe3dac0c99affea63 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841819.738216:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3ba00/0xe3dac0c99affea63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841819.738229:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3ba00/0xe3dac0c99affea63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787841819.738310:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:0.0:1787841819.738341:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005794a8ee reply state 00000000ee7cfaae transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3ba00/0xe3dac0c99affea63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841819.738354:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787841819.738946:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+52:10550:x1874687695049216:12345-192.168.201.1@tcp:36:bash.0 Request processed in 1533us (2385us total) trans 4294967394 rc 0/0 00000100:00100000:0.0:1787841819.738956:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 105 00000020:00080000:0.0:1787841819.738963:0:5839:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787841819.749292:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841819.749349:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695049344 00000100:00100000:2.0:1787841819.749366:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695049344 00000100:00100000:2.0:1787841819.749444:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 106 00000100:00100000:2.0:1787841819.749853:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cc00ddc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2767a54-6703-4908-8414-eab6601e2ceb+52:10550:x1874687695049344:12345-192.168.201.1@tcp:101:bash.0 00010000:00010000:2.0:1787841819.749905:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841819.749916:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3ba00/0xe3dac0c99affea63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841819.749929:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3ba00/0xe3dac0c99affea63 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841819.749932:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104e00/0xe3dac0c99affea6a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6939 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841819.749937:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3ba00/0xe3dac0c99affea63 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841819.749943:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbffa3ba00 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:3.0:1787841819.749948:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3ba00/0xe3dac0c99affea63 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841819.749957:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3ba00/0xe3dac0c99affea63 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841819.749992:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92cbc3b04b00) 00010000:00010000:3.0:1787841819.749995:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787841819.750002:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3ba00/0xe3dac0c99affea63 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841819.750008:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3ba00/0xe3dac0c99affea63 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841819.750040:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105800/0xe3dac0c99affea71 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841819.750056:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105800/0xe3dac0c99affea71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841819.750068:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105800/0xe3dac0c99affea71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787841819.750114:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1787841819.750127:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787841819.750155:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105800/0xe3dac0c99affea71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841819.750189:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104e00/0xe3dac0c99affea6a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6939 expref: 53 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841819.750206:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105800/0xe3dac0c99affea71 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6939 expref: 52 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841819.750214:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92cbc3b04b00) 00010000:00010000:2.0:1787841819.750217:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787841819.750220:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc6105800, rc 0) 00000100:00100000:2.0:1787841819.750312:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cc00ddc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2767a54-6703-4908-8414-eab6601e2ceb+52:10550:x1874687695049344:12345-192.168.201.1@tcp:101:bash.0 Request processed in 858us (1036us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841819.750321:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 106 00000100:00100000:2.0:1787841819.756902:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841819.756964:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695049600 00000100:00100000:2.0:1787841819.756976:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695049600 00000100:00100000:2.0:1787841819.757064:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 29 00000100:00100000:2.0:1787841819.757078:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cc00dded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b2767a54-6703-4908-8414-eab6601e2ceb+52:10550:x1874687695049600:12345-192.168.201.1@tcp:35:bash.0 00000100:00100000:2.0:1787841819.757491:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cc00dded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b2767a54-6703-4908-8414-eab6601e2ceb+53:10550:x1874687695049600:12345-192.168.201.1@tcp:35:bash.0 Request processed in 416us (605us total) trans 4294967395 rc 0/0 00000100:00100000:2.0:1787841819.757500:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 29 00000100:00100000:3.0:1787841819.884060:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841819.884190:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695049728 00000100:00100000:1.0:1787841819.884203:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695049728 00000100:00100000:1.0:1787841819.884282:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 107 00000100:00100000:1.0:1787841819.884294:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e2f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+53:10556:x1874687695049728:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:1.0:1787841819.884326:0:9449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841819.884352:0:9449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9ca00/0xe3dac0c99affea78 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6940 expref: -99 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841819.884436:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affea7f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841819.884466:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affea7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841819.884486:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affea7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787841819.884567:0:9449:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:1.0:1787841819.884571:0:9449:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787841819.884596:0:9449:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affea7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841819.884626:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9ca00/0xe3dac0c99affea78 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6940 expref: 55 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841819.884687:0:9449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affea7f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6940 expref: 54 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841819.884767:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92cbd1fc7300) 00010000:00010000:1.0:1787841819.884772:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787841819.884776:0:9449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cc00d9de00, rc 0) 00000100:00100000:1.0:1787841819.884849:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e2f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+54:10556:x1874687695049728:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 557us (804us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841819.884857:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 107 00000100:00100000:0.0:1787841819.907149:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841819.907769:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695049856 00000100:00100000:3.0:1787841819.907786:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695049856 00000100:00100000:3.0:1787841819.907883:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 108 00000100:00100000:3.0:1787841819.907896:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf07fbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+54:10556:x1874687695049856:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:3.0:1787841819.907927:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841819.907958:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149cc00/0xe3dac0c99affea86 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6947 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841819.908060:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affea8d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841819.908079:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affea8d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841819.908093:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affea8d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841819.908120:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149de00/0xe3dac0c99affea94 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841819.908127:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149de00/0xe3dac0c99affea94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841819.908157:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149de00/0xe3dac0c99affea94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841819.908293:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affea9b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841819.908302:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affea9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841819.908309:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affea9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787841819.908354:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1787841819.908360:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787841819.908384:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affea9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841819.908401:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affea9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841819.908411:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affea8d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841819.908417:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affea8d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841819.908424:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affea8d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841819.908431:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc149d400 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:3.0:1787841819.908436:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affea8d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841819.908464:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affea8d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841819.908824:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92cbd1fc7300) 00010000:00010000:3.0:1787841819.908828:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787841819.908835:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affea8d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841819.908842:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affea8d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841819.908861:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149de00/0xe3dac0c99affea94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841819.908946:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149de00/0xe3dac0c99affea94 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841819.908954:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149de00/0xe3dac0c99affea94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841819.908960:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc149de00 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:3.0:1787841819.908963:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149de00/0xe3dac0c99affea94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841819.908970:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149de00/0xe3dac0c99affea94 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841819.908977:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff92cbc89cdf00) 00010000:00010000:3.0:1787841819.908980:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787841819.908983:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149de00/0xe3dac0c99affea94 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841819.909001:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149de00/0xe3dac0c99affea94 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841819.909043:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149cc00/0xe3dac0c99affea86 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6947 expref: 56 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841819.909062:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affea9b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6947 expref: 55 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841819.909069:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92cbc3b04b00) 00010000:00010000:3.0:1787841819.909072:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787841819.909075:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc149c000, rc 0) 00000100:00100000:3.0:1787841819.910193:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf07fbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+55:10556:x1874687695049856:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 2293us (3052us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841819.910204:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 108 00000100:00100000:1.0:1787841819.918076:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841819.918267:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695050112 00000100:00100000:3.0:1787841819.918281:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695050112 00000100:00100000:3.0:1787841819.918366:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 109 00000100:00100000:3.0:1787841819.918379:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff42da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+55:10556:x1874687695050112:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:3.0:1787841819.918409:0:9449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841819.918438:0:9449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affeaa2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d694e expref: -99 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841819.919015:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affeaa9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841819.919036:0:9449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105800/0xe3dac0c99affea71 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6939 expref: 56 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841819.919055:0:9449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affea9b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6947 expref: 56 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841819.919065:0:9449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affeaa9 lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841819.919119:0:9449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affea9b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6947 expref: 56 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841819.919136:0:9449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affea9b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6947 expref: 56 pid: 5837 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841819.919153:0:9449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e2de00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9449:1874687714989440:192.168.201.1@tcp:104: 00010000:00010000:3.0:1787841819.919289:0:9449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105800/0xe3dac0c99affea71 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6939 expref: 56 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841819.919298:0:9449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105800/0xe3dac0c99affea71 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6939 expref: 56 pid: 5838 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841819.919308:0:9449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e2c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9449:1874687714989568:192.168.201.1@tcp:104: 00000100:00100000:3.0:1787841819.919335:0:9449:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbf046fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787841819.935148:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841819.935485:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695050240 00000100:00100000:3.0:1787841819.935500:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695050240 00010000:00010000:3.0:1787841819.935566:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affea9b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6947 expref: 57 pid: 5837 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841819.935646:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 52 00000100:00100000:3.0:1787841819.935657:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd5ae1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b2767a54-6703-4908-8414-eab6601e2ceb+57:2356:x1874687695050240:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787841819.936131:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787841819.936143:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affea9b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6947 expref: 57 pid: 5837 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841819.936160:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affea9b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6947 expref: 57 pid: 5837 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841819.936191:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92cbc3b04b00) 00010000:00010000:3.0:1787841819.936197:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affeaa9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841819.936208:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affeaa9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841819.936215:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787841819.936283:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd5ae1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b2767a54-6703-4908-8414-eab6601e2ceb+57:2356:x1874687695050240:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 628us (1150us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841819.936292:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 52 00010000:00010000:3.0:1787841819.942563:0:9449:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.201.1@tcp) returned -22 from blocking AST (req@00000000858bd93d x1874687714989440) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affea9b lrc: 1/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6947 expref: 56 pid: 5837 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841819.942596:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affea9b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6947 expref: 56 pid: 5837 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841819.942648:0:9449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e2de00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9449:1874687714989440:192.168.201.1@tcp:104: 00000100:00100000:3.0:1787841819.942666:0:9449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e2c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9449:1874687714989568:192.168.201.1@tcp:104: 00010000:00010000:3.0:1787841819.942778:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92cbc3b04b00) 00010000:00010000:3.0:1787841819.942785:0:9449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affeaa9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841819.942796:0:9449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affeaa9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841819.942806:0:9449:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affeaa9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841819.950663:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841819.951220:0:7633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695050368 00000100:00100000:2.0:1787841819.951236:0:7633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695050368 00010000:00010000:2.0:1787841819.951297:0:7633:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105800/0xe3dac0c99affea71 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6939 expref: 56 pid: 5838 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841819.951381:0:7633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 53 00000100:00100000:2.0:1787841819.951394:0:7633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd5ac780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b2767a54-6703-4908-8414-eab6601e2ceb+56:2357:x1874687695050368:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787841819.951417:0:7633:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787841819.951425:0:7633:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105800/0xe3dac0c99affea71 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6939 expref: 56 pid: 5838 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841819.951442:0:7633:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105800/0xe3dac0c99affea71 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6939 expref: 56 pid: 5838 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841819.951601:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105800/0xe3dac0c99affea71 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6939 expref: 56 pid: 5838 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841819.951624:0:7633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92cbc3b04b00) 00010000:00010000:2.0:1787841819.951631:0:7633:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affeaa9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841819.951642:0:7633:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affeaa9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841819.951652:0:7633:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affeaa9 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841819.951897:0:7633:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787841819.951967:0:7633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd5ac780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b2767a54-6703-4908-8414-eab6601e2ceb+55:2357:x1874687695050368:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 574us (1325us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841819.951976:0:7633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 53 00010000:00010000:3.0:1787841819.952049:0:9449:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affeaa9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841819.952059:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affeaa9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787841819.952088:0:9449:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1787841819.952342:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affeaa2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d694e expref: 56 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841819.952363:0:9449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affeaa9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d694e expref: 55 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841819.952371:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92cbc3b04b00) 00010000:00010000:3.0:1787841819.952374:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787841819.952383:0:9449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc149c400, rc 0) 00000100:00100000:3.0:1787841819.952415:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff42da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+55:10556:x1874687695050112:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 34040us (34355us total) trans 4294967396 rc 0/0 00000100:00100000:3.0:1787841819.952423:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 109 00000100:00100000:1.0:1787841819.959117:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841819.959221:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695050624 00000100:00100000:0.0:1787841819.959235:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695050624 00000100:00100000:0.0:1787841819.959336:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 7 00000100:00100000:0.0:1787841819.959349:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff42e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b2767a54-6703-4908-8414-eab6601e2ceb+55:10556:x1874687695050624:12345-192.168.201.1@tcp:103:lfs.0 00010000:00010000:0.0:1787841819.959374:0:7632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787841819.959415:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105a00/0xe3dac0c99affea08 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6924 expref: 55 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841819.959441:0:7632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92cbc3b04b00) 00010000:00010000:0.0:1787841819.959458:0:7632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787841819.959606:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff42e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b2767a54-6703-4908-8414-eab6601e2ceb+54:10556:x1874687695050624:12345-192.168.201.1@tcp:103:lfs.0 Request processed in 258us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841819.959616:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 7 00000100:00100000:1.0:1787841819.964139:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841819.968650:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695050752 00000100:00100000:2.0:1787841819.969429:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695050752 00000100:00100000:2.0:1787841819.969655:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 110 00000100:00100000:2.0:1787841819.969681:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff3e92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2767a54-6703-4908-8414-eab6601e2ceb+54:10556:x1874687695050752:12345-192.168.201.1@tcp:58:lfs.0 00010000:00010000:2.0:1787841819.970081:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105800/0xe3dac0c99affeab7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841819.970106:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105800/0xe3dac0c99affeab7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841819.970122:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105800/0xe3dac0c99affeab7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787841819.971731:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1787841819.972193:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff3e92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2767a54-6703-4908-8414-eab6601e2ceb+54:10556:x1874687695050752:12345-192.168.201.1@tcp:58:lfs.0 Request processed in 2515us (8061us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841819.972211:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 110 00000100:00100000:1.0:1787841819.985572:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841819.986215:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695050880 00000100:00100000:0.0:1787841819.986229:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695050880 00000100:00100000:0.0:1787841819.986315:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 111 00000100:00100000:0.0:1787841819.986327:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff3e9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+54:10556:x1874687695050880:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:0.0:1787841819.986357:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841819.986387:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b800/0xe3dac0c99affeabe lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6955 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841819.986610:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105800/0xe3dac0c99affeab7 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841819.986624:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b800/0xe3dac0c99affeabe lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6955 expref: 55 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841819.986679:0:5839:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105800/0xe3dac0c99affeab7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841819.986742:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b800/0xe3dac0c99affeabe lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6955 expref: 55 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841819.986828:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92cbc3b04b00) 00010000:00010000:0.0:1787841819.986832:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787841819.986837:0:5839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b800/0xe3dac0c99affeabe lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6955 expref: 55 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841819.986846:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbffa3b800, rc 0) 00000100:00100000:0.0:1787841819.986922:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff3e9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+55:10556:x1874687695050880:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 598us (1365us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841819.986930:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 111 00010000:00010000:2.0:1787841820.231923:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787841820.353383:0:11682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787841820.353397:0:11682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787841820.354637:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1787841820.354648:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787841820.356609:0:11682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbc9546940 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11682:1874687714989696:192.168.201.1@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787841820.356807:0:11682:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbcdb29240 going to sleep for 11 seconds 00000100:00100000:0.0:1787841820.366409:0:11682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbc9546940 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11682:1874687714989696:192.168.201.1@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787841820.373180:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841820.373684:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695051008 00000100:00100000:3.0:1787841820.373730:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695051008 00000100:00100000:3.0:1787841820.374097:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 112 00000100:00100000:3.0:1787841820.374119:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff3e8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+55:10557:x1874687695051008:12345-192.168.201.1@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787841820.374168:0:5837:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787841820.374602:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff3e8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+55:10557:x1874687695051008:12345-192.168.201.1@tcp:53:lhsmtool_posix.0 Request processed in 485us (1436us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841820.374611:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 112 00000100:00100000:1.0:1787841820.383800:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841820.384732:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695051136 00000100:00100000:0.0:1787841820.384755:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695051136 00000100:00100000:0.0:1787841820.384840:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 113 00000100:00100000:0.0:1787841820.384852:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff3e83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+55:10557:x1874687695051136:12345-192.168.201.1@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787841820.384987:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b600/0xe3dac0c99affeac5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841820.385022:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b600/0xe3dac0c99affeac5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841820.385038:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b600/0xe3dac0c99affeac5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841820.385058:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b000/0xe3dac0c99affeacc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841820.385066:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b000/0xe3dac0c99affeacc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841820.385073:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b000/0xe3dac0c99affeacc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841820.385110:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3ba00/0xe3dac0c99affead3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841820.385121:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3ba00/0xe3dac0c99affead3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841820.385128:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3ba00/0xe3dac0c99affead3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787841820.385181:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1787841820.385187:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787841820.385203:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3ba00/0xe3dac0c99affead3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841820.385217:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b600/0xe3dac0c99affeac5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841820.385231:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b600/0xe3dac0c99affeac5 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841820.385238:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b600/0xe3dac0c99affeac5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841820.385246:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbffa3b600 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:0.0:1787841820.385263:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b600/0xe3dac0c99affeac5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841820.385272:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b600/0xe3dac0c99affeac5 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841820.385287:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff92cbc57e3b00) 00010000:00010000:0.0:1787841820.385291:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841820.385298:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b600/0xe3dac0c99affeac5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841820.385304:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b600/0xe3dac0c99affeac5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841820.385323:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b000/0xe3dac0c99affeacc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841820.385330:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b000/0xe3dac0c99affeacc lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841820.385337:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b000/0xe3dac0c99affeacc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841820.385343:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbffa3b000 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:0.0:1787841820.385353:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b000/0xe3dac0c99affeacc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841820.385360:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b000/0xe3dac0c99affeacc lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841820.385369:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff92cbc57e3200) 00010000:00010000:0.0:1787841820.385372:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841820.385375:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b000/0xe3dac0c99affeacc lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841820.385381:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b000/0xe3dac0c99affeacc lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841820.385397:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3ba00/0xe3dac0c99affead3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841820.385404:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3ba00/0xe3dac0c99affead3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841820.385410:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3ba00/0xe3dac0c99affead3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841820.385416:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbffa3ba00 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:0.0:1787841820.385419:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3ba00/0xe3dac0c99affead3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841820.385425:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3ba00/0xe3dac0c99affead3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841820.385434:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92cbc3b04b00) 00010000:00010000:0.0:1787841820.385436:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841820.385445:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3ba00/0xe3dac0c99affead3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841820.385451:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3ba00/0xe3dac0c99affead3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841820.386200:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff3e83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+55:10557:x1874687695051136:12345-192.168.201.1@tcp:34:lhsmtool_posix.0 Request processed in 1344us (2410us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841820.386215:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 113 00000100:00100000:1.0:1787841820.397361:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841820.398278:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695051392 00000100:00100000:3.0:1787841820.398296:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695051392 00000100:00100000:3.0:1787841820.398394:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 114 00000100:00100000:3.0:1787841820.398407:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6ca61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+55:10557:x1874687695051392:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787841820.398438:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841820.398482:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affeada lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d695c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841820.398617:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affeae1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841820.398637:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affeae1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841820.398650:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affeae1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787841820.398695:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1787841820.398880:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affeae1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841820.398888:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affeae1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841820.398896:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affeae1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841820.398904:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc149c000 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:3.0:1787841820.398909:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affeae1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841820.398919:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affeae1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841820.398935:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92cbc3b04b00) 00010000:00010000:3.0:1787841820.398939:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787841820.398944:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affeae1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841820.398952:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affeae1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841820.399024:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affeada lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d695c expref: 57 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841820.399039:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff92cbc57e3b00) 00010000:00010000:3.0:1787841820.399042:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787841820.399053:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affeada lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d695c expref: 57 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841820.399067:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc149d600, rc 0) 00000100:00100000:3.0:1787841820.399170:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6ca61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+56:10557:x1874687695051392:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 Request processed in 765us (1825us total) trans 4294967397 rc 301/301 00000100:00100000:3.0:1787841820.399180:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 114 00000100:00100000:0.0:1787841820.405290:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841820.405733:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695051520 00000100:00100000:1.0:1787841820.405746:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695051520 00000100:00100000:1.0:1787841820.405822:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 115 00000100:00100000:1.0:1787841820.405834:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbc9546940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+56:10557:x1874687695051520:12345-192.168.201.1@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787841820.405886:0:5839:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787841820.406577:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbc9546940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+56:10557:x1874687695051520:12345-192.168.201.1@tcp:53:lhsmtool_posix.0 Request processed in 744us (1299us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841820.406606:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 115 00000100:00100000:1.0:1787841820.414287:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841820.414399:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695051776 00000100:00100000:3.0:1787841820.414412:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695051776 00000100:00100000:3.0:1787841820.414498:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 116 00000100:00100000:3.0:1787841820.414511:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe99c6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+56:10557:x1874687695051776:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787841820.414544:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841820.414548:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787841820.414588:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affea7f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6940 expref: 56 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841820.414617:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92cbd1fc7300) 00010000:00010000:3.0:1787841820.414625:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787841820.414646:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affeaef lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6963 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787841820.418163:0:5837:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:2.0:1787841820.428014:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105400/0xe3dac0c99affeaf6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841820.428047:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105400/0xe3dac0c99affeaf6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841820.428064:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105400/0xe3dac0c99affeaf6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841820.428516:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affeaef lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6963 expref: 58 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841820.431693:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105400/0xe3dac0c99affeaf6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6963 expref: 57 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841820.432000:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff92cbc3b04900) 00010000:00010000:2.0:1787841820.432004:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787841820.432010:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc6105400, rc 0) 00000100:00100000:2.0:1787841820.432115:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe99c6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+57:10557:x1874687695051776:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 Request processed in 17605us (17840us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1787841820.432125:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 116 00000100:00100000:2.0:1787841820.438769:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841820.439476:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695052032 00000100:00100000:3.0:1787841820.439495:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695052032 00000100:00100000:3.0:1787841820.439583:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 117 00000100:00100000:3.0:1787841820.439595:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cc00ddd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+57:10557:x1874687695052032:12345-192.168.201.1@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787841820.439694:0:9449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787841820.439795:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105400/0xe3dac0c99affeaf6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6963 expref: 57 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841820.439820:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff92cbc3b04900) 00010000:00010000:3.0:1787841820.439836:0:9449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787841820.439876:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affeb04 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841820.439894:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affeb04 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841820.439905:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affeb04 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841820.439926:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149cc00/0xe3dac0c99affeb0b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x1066e559 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841820.439933:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149cc00/0xe3dac0c99affeb0b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x1066e559 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841820.439940:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149cc00/0xe3dac0c99affeb0b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x1066e559 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841820.440046:0:9449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affeb04 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841820.440054:0:9449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affeb04 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841820.440062:0:9449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affeb04 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841820.440068:0:9449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc149c000 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:3.0:1787841820.440080:0:9449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affeb04 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841820.440090:0:9449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affeb04 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841820.440099:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92cbd1fc7300) 00010000:00010000:3.0:1787841820.440638:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787841820.440645:0:9449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affeb04 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841820.440652:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affeb04 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841820.440678:0:9449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149cc00/0xe3dac0c99affeb0b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x1066e559 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841820.440685:0:9449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149cc00/0xe3dac0c99affeb0b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x1066e559 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841820.440692:0:9449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149cc00/0xe3dac0c99affeb0b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x1066e559 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841820.440743:0:9449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc149cc00 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:3.0:1787841820.440747:0:9449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149cc00/0xe3dac0c99affeb0b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x1066e559 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841820.440754:0:9449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149cc00/0xe3dac0c99affeb0b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x1066e559 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841820.440764:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x1066e559 (ffff92cbc89cdf00) 00010000:00010000:3.0:1787841820.440766:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787841820.440777:0:9449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149cc00/0xe3dac0c99affeb0b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x1066e559 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841820.440783:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149cc00/0xe3dac0c99affeb0b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x1066e559 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841820.440952:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cc00ddd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+56:10557:x1874687695052032:12345-192.168.201.1@tcp:36:lhsmtool_posix.0 Request processed in 1356us (2191us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787841820.440961:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 117 00000100:00100000:1.0:1787841820.451757:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841820.451929:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695052160 00000100:00100000:2.0:1787841820.451946:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695052160 00000100:00100000:2.0:1787841820.452028:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 118 00000100:00100000:2.0:1787841820.452039:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe99c4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2767a54-6703-4908-8414-eab6601e2ceb+56:10557:x1874687695052160:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787841820.452062:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841820.452089:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105000/0xe3dac0c99affeb12 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d696a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841820.452124:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105c00/0xe3dac0c99affeb19 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841820.452137:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105c00/0xe3dac0c99affeb19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841820.452148:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105c00/0xe3dac0c99affeb19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841820.452252:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105000/0xe3dac0c99affeb12 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d696a expref: 58 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841820.452286:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105c00/0xe3dac0c99affeb19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d696a expref: 57 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841820.452295:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff92cbc3b04400) 00010000:00010000:2.0:1787841820.452298:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787841820.452302:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc6105c00, rc 0) 00000100:00100000:2.0:1787841820.452405:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe99c4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2767a54-6703-4908-8414-eab6601e2ceb+57:10557:x1874687695052160:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 Request processed in 367us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841820.452414:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 118 00000100:00100000:1.0:1787841820.462817:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841820.462936:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695052416 00000100:00100000:3.0:1787841820.462949:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695052416 00000100:00100000:3.0:1787841820.463043:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 119 00000100:00100000:3.0:1787841820.463057:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe99c6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+57:10557:x1874687695052416:12345-192.168.201.1@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787841820.463202:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149cc00/0xe3dac0c99affeb20 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841820.463228:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149cc00/0xe3dac0c99affeb20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841820.463247:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149cc00/0xe3dac0c99affeb20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787841820.464088:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:3.0:1787841820.466907:0:5839:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 360462402066ns, next at 361462398719ns, rc = 0 00000004:00010000:2.0:1787841820.467244:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000616842c5 reply state 00000000eb370d70 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149cc00/0xe3dac0c99affeb20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841820.467265:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787841820.467432:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe99c6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+59:10557:x1874687695052416:12345-192.168.201.1@tcp:36:lhsmtool_posix.0 Request processed in 4373us (4628us total) trans 4294967399 rc 0/0 00000100:00100000:2.0:1787841820.467442:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 119 00010000:00010000:3.0:1787841820.482613:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149cc00/0xe3dac0c99affeb20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841820.482638:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149cc00/0xe3dac0c99affeb20 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841820.482649:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149cc00/0xe3dac0c99affeb20 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841820.482690:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc149cc00 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:3.0:1787841820.482758:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149cc00/0xe3dac0c99affeb20 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841820.482770:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149cc00/0xe3dac0c99affeb20 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841820.482793:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff92cbc3b04400) 00010000:00010000:3.0:1787841820.482797:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787841820.482805:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149cc00/0xe3dac0c99affeb20 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841820.482812:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149cc00/0xe3dac0c99affeb20 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841820.484758:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841820.484975:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695052544 00000100:00100000:3.0:1787841820.484992:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695052544 00000100:00100000:3.0:1787841820.485084:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 120 00000100:00100000:3.0:1787841820.485097:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe99c43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+58:10557:x1874687695052544:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787841820.485144:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841820.485172:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affeb27 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6971 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841820.485268:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affeb27 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6971 expref: 59 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841820.485285:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affeb27 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6971 expref: 59 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841820.485337:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff92cbc3b04400) 00010000:00010000:3.0:1787841820.485341:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787841820.485345:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc149c000, rc 0) 00000100:00100000:3.0:1787841820.485433:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe99c43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+59:10557:x1874687695052544:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 Request processed in 338us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841820.485441:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 120 00000100:00100000:1.0:1787841820.492852:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841820.492953:0:9572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695052672 00000100:00100000:0.0:1787841820.492981:0:9572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695052672 00000100:00100000:0.0:1787841820.493133:0:9572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 38 00000100:00100000:0.0:1787841820.493146:0:9572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf8caf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b2767a54-6703-4908-8414-eab6601e2ceb+8:2356:x1874687695052672:12345-192.168.201.1@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1787841820.493933:0:9572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf8caf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b2767a54-6703-4908-8414-eab6601e2ceb+9:2356:x1874687695052672:12345-192.168.201.1@tcp:2:lhsmtool_posix.0 Request processed in 786us (1691us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1787841820.493943:0:9572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 38 00000100:00080000:1.0:1787841820.494500:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787841820.509008:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841820.509153:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695052928 00000100:00100000:2.0:1787841820.509167:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695052928 00000100:00100000:2.0:1787841820.509246:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 30 00000100:00100000:2.0:1787841820.509258:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe99c6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b2767a54-6703-4908-8414-eab6601e2ceb+59:10557:x1874687695052928:12345-192.168.201.1@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787841820.509819:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe99c6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b2767a54-6703-4908-8414-eab6601e2ceb+60:10557:x1874687695052928:12345-192.168.201.1@tcp:35:lhsmtool_posix.0 Request processed in 561us (825us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1787841820.509828:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 30 00000100:00100000:2.0:1787841820.522443:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841820.523635:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695053184 00000100:00100000:1.0:1787841820.523653:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695053184 00000100:00100000:1.0:1787841820.523762:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 121 00000100:00100000:1.0:1787841820.523774:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cc00ddfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+60:10557:x1874687695053184:12345-192.168.201.1@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787841820.523972:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cc00ddfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+60:10557:x1874687695053184:12345-192.168.201.1@tcp:57:lhsmtool_posix.0 Request processed in 199us (3283us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841820.523981:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 121 00000100:00100000:1.0:1787841820.540684:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841820.540878:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695053312 00000100:00100000:3.0:1787841820.540888:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695053312 00000100:00100000:3.0:1787841820.540946:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 122 00000100:00100000:3.0:1787841820.540955:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe99c52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+60:10557:x1874687695053312:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787841820.540975:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841820.541010:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149cc00/0xe3dac0c99affeb2e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6978 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841820.541080:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149de00/0xe3dac0c99affeb35 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841820.541093:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149de00/0xe3dac0c99affeb35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841820.541105:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149de00/0xe3dac0c99affeb35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787841820.541789:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787841820.541818:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149de00/0xe3dac0c99affeb35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841820.541852:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149cc00/0xe3dac0c99affeb2e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6978 expref: 62 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841820.541890:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149de00/0xe3dac0c99affeb35 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6978 expref: 61 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841820.541899:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff92cbc3b04400) 00010000:00010000:3.0:1787841820.541902:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787841820.541906:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc149de00, rc 0) 00000100:00100000:3.0:1787841820.541997:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe99c52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+61:10557:x1874687695053312:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 Request processed in 1042us (1333us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841820.542008:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 122 00000100:00100000:0.0:1787841820.549115:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841820.549453:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695053440 00000100:00100000:2.0:1787841820.549501:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695053440 00000100:00100000:2.0:1787841820.549585:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 39 00000100:00100000:2.0:1787841820.549599:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbc9544780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b2767a54-6703-4908-8414-eab6601e2ceb+9:2356:x1874687695053440:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787841820.549628:0:6688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841820.549658:0:6688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000324a6bfe/0xe3dac0c99affeb3c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d697f expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787841820.549748:0:6688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a904d1d, blocks: 0x1 00010000:00010000:2.0:1787841820.549782:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=360s v=(0 0) 00010000:00010000:2.0:1787841820.549789:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787841820.549804:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000324a6bfe/0xe3dac0c99affeb3c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d697f expref: 10 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841820.549831:0:6688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000324a6bfe/0xe3dac0c99affeb3c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d697f expref: 10 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841820.549851:0:6688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc6104000, rc 0) 00000100:00100000:2.0:1787841820.549966:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbc9544780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b2767a54-6703-4908-8414-eab6601e2ceb+10:2356:x1874687695053440:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 Request processed in 370us (884us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841820.549976:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 39 00000100:00100000:2.0:1787841820.560917:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841820.561431:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695053696 00000100:00100000:1.0:1787841820.561449:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695053696 00000100:00100000:1.0:1787841820.561556:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 123 00000100:00100000:1.0:1787841820.561568:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cc00ddc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+61:10557:x1874687695053696:12345-192.168.201.1@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787841820.561801:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cc00ddc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+61:10557:x1874687695053696:12345-192.168.201.1@tcp:57:lhsmtool_posix.0 Request processed in 234us (903us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841820.561809:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 123 00000100:00100000:1.0:1787841820.576753:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841820.576940:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695053824 00000100:00100000:2.0:1787841820.576955:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695053824 00000100:00100000:2.0:1787841820.577027:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 40 00000100:00100000:2.0:1787841820.577039:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe99c7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b2767a54-6703-4908-8414-eab6601e2ceb+10:10557:x1874687695053824:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787841820.577066:0:6686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841820.577110:0:6686:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095d604af/0xe3dac0c99affeb43 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6986 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841820.577154:0:6686:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000324a6bfe/0xe3dac0c99affeb3c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d697f expref: 11 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841820.577166:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787841820.577171:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787841820.577178:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095d604af/0xe3dac0c99affeb43 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6986 expref: 11 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841820.577224:0:6686:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000324a6bfe/0xe3dac0c99affeb3c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d697f expref: 11 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841820.577241:0:6686:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000324a6bfe/0xe3dac0c99affeb3c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d697f expref: 11 pid: 6688 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841820.577259:0:6686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cc00ddd680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6686:1874687714989824:192.168.201.1@tcp:104: 00000100:00100000:2.0:1787841820.577387:0:6686:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc81939c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787841820.582036:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841820.582187:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695053952 00000100:00100000:3.0:1787841820.582207:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695053952 00010000:00010000:3.0:1787841820.582276:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000324a6bfe/0xe3dac0c99affeb3c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d697f expref: 12 pid: 6688 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841820.582348:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 54 00000100:00100000:3.0:1787841820.582360:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcdb7b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b2767a54-6703-4908-8414-eab6601e2ceb+12:2357:x1874687695053952:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787841820.582378:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787841820.582649:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000324a6bfe/0xe3dac0c99affeb3c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d697f expref: 12 pid: 6688 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841820.582675:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000324a6bfe/0xe3dac0c99affeb3c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d697f expref: 12 pid: 6688 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841820.582731:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787841820.583072:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787841820.583108:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000095d604af/0xe3dac0c99affeb43 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6986 expref: 12 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841820.583122:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095d604af/0xe3dac0c99affeb43 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6986 expref: 12 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841820.583172:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000095d604af/0xe3dac0c99affeb43 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6986 expref: 12 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841820.583192:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e2c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5824:1874687714989952:192.168.201.1@tcp:105: 00000100:00100000:3.0:1787841820.583313:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbf046f000 going to sleep for 11 seconds 00010000:00010000:2.0:1787841820.591840:0:6686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000324a6bfe/0xe3dac0c99affeb3c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d697f expref: 12 pid: 6688 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841820.591876:0:6686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cc00ddd680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6686:1874687714989824:192.168.201.1@tcp:104: 00010000:00010000:2.0:1787841820.591918:0:6686:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000095d604af/0xe3dac0c99affeb43 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6986 expref: 11 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841820.591964:0:6686:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc6105600, rc 0) 00000100:00100000:2.0:1787841820.592069:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe99c7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b2767a54-6703-4908-8414-eab6601e2ceb+11:10557:x1874687695053824:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 Request processed in 15031us (15381us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841820.592081:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 40 00000100:00100000:3.0:1787841820.592369:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e2c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5824:1874687714989952:192.168.201.1@tcp:105: 00010000:00010000:3.0:1787841820.592399:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787841820.592478:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcdb7b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b2767a54-6703-4908-8414-eab6601e2ceb+10:2357:x1874687695053952:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 10120us (10470us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841820.592490:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 54 00000100:00100000:1.0:1787841820.607839:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841820.608185:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695054080 00000100:00100000:3.0:1787841820.608195:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695054080 00002000:00100000:3.0:1787841820.608245:0:6694:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff92cbe99c4780 x1874687695054080/t0(0) o4->b2767a54-6703-4908-8414-eab6601e2ceb@192.168.201.1@tcp:321/0 lens 504/0 e 0 to 0 dl 1787841831 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787841820.608256:0:6694:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff92cbe99c4780 with x1874687695054080 ext(0->12) 00002000:00010000:3.0:1787841820.608262:0:6694:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92cbe99c4780 00000100:00100000:3.0:1787841820.608299:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 2 00000100:00100000:3.0:1787841820.608307:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe99c4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b2767a54-6703-4908-8414-eab6601e2ceb+10:2357:x1874687695054080:12345-192.168.201.1@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1787841820.609964:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe99c4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b2767a54-6703-4908-8414-eab6601e2ceb+12:2357:x1874687695054080:12345-192.168.201.1@tcp:4:lhsmtool_posix.0 Request processed in 1648us (2125us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1787841820.609986:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 2 00002000:00100000:3.0:1787841820.610011:0:6694:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff92cbe99c4780 x1874687695054080/t4294967308(0) o4->b2767a54-6703-4908-8414-eab6601e2ceb@192.168.201.1@tcp:321/0 lens 504/448 e 0 to 0 dl 1787841831 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787841820.610023:0:6694:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff92cbe99c4780 with x1874687695054080 ext(0->12) 00002000:00010000:3.0:1787841820.610031:0:6694:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92cbe99c4780 00000100:00100000:0.0:1787841820.618876:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841820.619629:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695054208 00000100:00100000:2.0:1787841820.619648:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695054208 00000100:00100000:2.0:1787841820.619802:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 124 00000100:00100000:2.0:1787841820.619814:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbc95461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2767a54-6703-4908-8414-eab6601e2ceb+61:10557:x1874687695054208:12345-192.168.201.1@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1787841820.760325:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967394 is committed 00000020:00080000:2.0:1787841820.760372:0:5860:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff92cbf0462840 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:2.0:1787841820.760380:0:5860:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff92cbf6ed2c00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff92cbf0462180 00000020:00080000:2.0:1787841820.760385:0:5860:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff92cbf6ed2400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff92cbf92f9400 00000004:00080000:2.0:1787841820.760452:0:5860:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:2.0:1787841820.760630:0:5860:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000001:00080000:2.0:1787841820.760640:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000020:00080000:2.0:1787841820.760675:0:5860:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff92cbf0784e40 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:2.0:1787841820.760680:0:5860:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff92cbc79bda00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff92cbf0784c00 00000020:00080000:2.0:1787841820.760684:0:5860:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff92cbc79bd200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff92cbff3c3400 00000004:00080000:2.0:1787841820.760736:0:5860:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000004:00080000:2.0:1787841820.760770:0:5860:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000100:00100000:2.0:1787841820.761009:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cc00ddd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874687714990080:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787841820.761124:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841820.761251:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cc00ddda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687714990208:0@lo:2:osp-syn-0-0.0 00000020:00080000:1.0:1787841820.761849:0:5871:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:1.0:1787841820.764498:0:5871:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1787841820.765918:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e2da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874687714990336:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787841820.769406:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841820.769710:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714990080 00000100:00100000:0.0:1787841820.769723:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714990080 00000100:00100000:0.0:1787841820.769808:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714990208 00000100:00100000:0.0:1787841820.769812:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714990208 00000100:00100000:0.0:1787841820.769840:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787841820.769852:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cc00dde1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3301:x1874687714990080:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1787841820.769902:0:6687:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:0.0:1787841820.769938:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b70be7c/0xe3dac0c99affeb4a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841820.769988:0:6687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008db123e9/0xe3dac0c99affe90c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d68e5 expref: 11 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841820.769999:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1787841820.770004:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787841820.770010:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b70be7c/0xe3dac0c99affeb4a lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841820.770060:0:6687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008db123e9/0xe3dac0c99affe90c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d68e5 expref: 11 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841820.770078:0:6687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008db123e9/0xe3dac0c99affe90c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d68e5 expref: 11 pid: 6686 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841820.770098:0:6687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbcd5ae1c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6687:1874687714990464:192.168.201.1@tcp:104: 00000100:00100000:0.0:1787841820.770212:0:6687:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbcdb29b40 going to sleep for 11 seconds 00000100:00080000:0.0:1787841820.770228:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787841820.770245:0:9572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787841820.770253:0:9572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbc9546580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3298:x1874687714990208:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1787841820.770538:0:9572:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1787841820.770543:0:9572:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787841821 00002000:00010000:0.0:1787841820.770547:0:9572:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787841820.770551:0:9572:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1787841821 -> 1787841821 00002000:00010000:0.0:1787841820.770554:0:9572:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1787841820.770634:0:9572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbc9546580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3298:x1874687714990208:12345-0@lo:2:osp-syn-0-0.0 Request processed in 381us (1246us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1787841820.770643:0:9572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000004:00080000:0.0:1787841820.770744:0:3298:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff92cc00ddda40/2, rc 0, transno 4294967309 00000100:00100000:0.0:1787841820.770754:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cc00ddda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687714990208:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1787841820.778823:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841820.778902:0:6687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbcd5ae1c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6687:1874687714990464:192.168.201.1@tcp:104: 00010000:00010000:0.0:1787841820.778945:0:6687:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003b70be7c/0xe3dac0c99affeb4a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841820.778988:0:7633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695054336 00000100:00100000:0.0:1787841820.778995:0:7633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695054336 00010000:00010000:0.0:1787841820.779041:0:7633:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008db123e9/0xe3dac0c99affe90c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d68e5 expref: 12 pid: 6686 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841820.779080:0:7633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 55 00000100:00100000:0.0:1787841820.779091:0:7633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd5ac780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b2767a54-6703-4908-8414-eab6601e2ceb+12:2357:x1874687695054336:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787841820.779109:0:7633:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787841820.779116:0:7633:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008db123e9/0xe3dac0c99affe90c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d68e5 expref: 12 pid: 6686 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841820.779131:0:7633:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008db123e9/0xe3dac0c99affe90c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d68e5 expref: 12 pid: 6686 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841820.780243:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008db123e9/0xe3dac0c99affe90c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d68e5 expref: 12 pid: 6686 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841820.780294:0:7633:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787841820.780300:0:7633:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787841820.780306:0:7633:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003b70be7c/0xe3dac0c99affeb4a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841820.780318:0:7633:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b70be7c/0xe3dac0c99affeb4a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841820.780369:0:7633:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787841820.780452:0:6687:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003b70be7c/0xe3dac0c99affeb4a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841820.780473:0:6687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b70be7c/0xe3dac0c99affeb4a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841820.780488:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b70be7c/0xe3dac0c99affeb4a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841820.780497:0:6687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b70be7c/0xe3dac0c99affeb4a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841820.780521:0:6687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787841820.781285:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841820.781521:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cc00dde1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3301:x1874687714990080:12345-0@lo:6:osp-syn-0-0.0 Request processed in 11670us (20397us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1787841820.781532:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787841820.781558:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714990336 00000100:00100000:1.0:1787841820.781566:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714990336 00000100:00100000:1.0:1787841820.781603:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787841820.781611:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1874687714990336:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1787841820.781638:0:6687:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:1.0:1787841820.781681:0:6687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a904d1b, atime: 0x6a904d1b, ctime: 0x6a904d1b, blocks: 0xb 00010000:00010000:1.0:1787841820.781689:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060899752/0xe3dac0c99affeb51 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841820.782198:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=360s v=(0 0) 00010000:00010000:1.0:1787841820.782205:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787841820.782214:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060899752/0xe3dac0c99affeb51 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841820.782283:0:7633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd5ac780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b2767a54-6703-4908-8414-eab6601e2ceb+11:2357:x1874687695054336:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 1366us (1650us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841820.782304:0:7633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 55 00010000:00010000:1.0:1787841820.782339:0:6687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000060899752/0xe3dac0c99affeb51 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841820.782355:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060899752/0xe3dac0c99affeb51 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841820.782363:0:6687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000060899752/0xe3dac0c99affeb51 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841820.782386:0:6687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:3.0:1787841820.782863:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff92cc00ddd680/2, rc 0, transno 4294967310 00000100:00100000:3.0:1787841820.782872:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cc00ddd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874687714990080:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787841820.783536:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3299:x1874687714990336:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1922us (2250us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1787841820.783548:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787841820.783777:0:3299:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:3.0:1787841820.783786:0:3299:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967303 00010000:00010000:2.0:1787841820.783796:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000004:00080000:3.0:1787841820.783812:0:3299:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff92cbff42ed00, transno 4294967301 00010000:00010000:2.0:1787841820.783823:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b70be7c/0xe3dac0c99affeb4a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841820.783838:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbffa3a000 already unused, calling callback (ffffffffc17a4500) 00010000:00010000:2.0:1787841820.783844:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b70be7c/0xe3dac0c99affeb4a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841820.783856:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b70be7c/0xe3dac0c99affeb4a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841820.783890:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b70be7c/0xe3dac0c99affeb4a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841820.783899:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b70be7c/0xe3dac0c99affeb4a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787841820.783921:0:3299:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967303 00010000:00010000:2.0:1787841820.783944:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787841820.783956:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000060899752/0xe3dac0c99affeb51 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841820.783964:0:3299:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff92cbf6e2da40 x1874687714990336/t4294967304(4294967304) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787841836 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1787841820.783967:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cc00d9d000 already unused, calling callback (ffffffffc17a4500) 00010000:00010000:2.0:1787841820.783974:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000060899752/0xe3dac0c99affeb51 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787841820.783994:0:3299:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff92cbf6e2da40/2, rc 0, transno 4294967304 00010000:00010000:2.0:1787841820.783997:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000060899752/0xe3dac0c99affeb51 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841820.784005:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e2da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874687714990336:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1787841820.784048:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000060899752/0xe3dac0c99affeb51 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841820.784057:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060899752/0xe3dac0c99affeb51 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841820.784087:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841820.784089:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841820.784092:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841820.784104:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787841820.793751:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbc95461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2767a54-6703-4908-8414-eab6601e2ceb+15:10557:x1874687695054208:12345-192.168.201.1@tcp:44:lhsmtool_posix.0 Request processed in 173917us (174863us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841820.793772:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 124 00000100:00100000:0.0:1787841820.803873:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841820.804036:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695054464 00000100:00100000:2.0:1787841820.804050:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695054464 00000100:00100000:2.0:1787841820.804127:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 44 00000100:00100000:2.0:1787841820.804155:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd5ae1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b2767a54-6703-4908-8414-eab6601e2ceb+11:2357:x1874687695054464:12345-192.168.201.1@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1787841820.909372:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:3.0:1787841820.909399:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:3.0:1787841820.909410:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:3.0:1787841820.909421:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:2.0:1787841820.910112:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd5ae1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b2767a54-6703-4908-8414-eab6601e2ceb+6:2357:x1874687695054464:12345-192.168.201.1@tcp:16:lhsmtool_posix.0 Request processed in 105965us (106258us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841820.910126:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 44 00000100:00100000:1.0:1787841820.915868:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841820.915968:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695054720 00000100:00100000:3.0:1787841820.915979:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695054720 00000100:00100000:3.0:1787841820.916050:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 125 00000100:00100000:3.0:1787841820.916061:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe99c5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+15:10557:x1874687695054720:12345-192.168.201.1@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787841820.916134:0:9449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787841820.916179:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149de00/0xe3dac0c99affeb35 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6978 expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841820.916200:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff92cbc3b04400) 00010000:00010000:3.0:1787841820.916205:0:9449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787841820.916235:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149cc00/0xe3dac0c99affeb58 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841820.916249:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149cc00/0xe3dac0c99affeb58 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841820.916259:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149cc00/0xe3dac0c99affeb58 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787841820.916532:0:9449:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004a716a54 reply state 0000000072350ff9 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149cc00/0xe3dac0c99affeb58 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841820.916542:0:9449:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787841820.916648:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe99c5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+16:10557:x1874687695054720:12345-192.168.201.1@tcp:36:lhsmtool_posix.0 Request processed in 588us (790us total) trans 4294967401 rc 0/0 00000100:00100000:3.0:1787841820.916663:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 125 00010000:00010000:3.0:1787841820.922687:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149cc00/0xe3dac0c99affeb58 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841820.922729:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149cc00/0xe3dac0c99affeb58 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841820.922747:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149cc00/0xe3dac0c99affeb58 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841820.922772:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc149cc00 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:3.0:1787841820.922778:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149cc00/0xe3dac0c99affeb58 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841820.922786:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149cc00/0xe3dac0c99affeb58 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841820.922804:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff92cbc3b04400) 00010000:00010000:3.0:1787841820.922808:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787841820.922813:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149cc00/0xe3dac0c99affeb58 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841820.922820:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149cc00/0xe3dac0c99affeb58 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841820.924235:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841820.924369:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695054848 00000100:00100000:0.0:1787841820.924380:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695054848 00000100:00100000:0.0:1787841820.924433:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 45 00000100:00100000:0.0:1787841820.924443:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe99c5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b2767a54-6703-4908-8414-eab6601e2ceb+6:2357:x1874687695054848:12345-192.168.201.1@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787841820.924890:0:6686:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1787841820.924895:0:6686:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1787841821 -> 1787841820 00002000:00010000:0.0:1787841820.924897:0:6686:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787841819 00002000:00010000:0.0:1787841820.924899:0:6686:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1787841821 -> 1787841820 00002000:00010000:0.0:1787841820.924901:0:6686:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1787841820.924984:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe99c5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b2767a54-6703-4908-8414-eab6601e2ceb+7:2357:x1874687695054848:12345-192.168.201.1@tcp:2:lhsmtool_posix.0 Request processed in 541us (759us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1787841820.924993:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 45 00000100:00100000:0.0:1787841820.928686:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841820.928899:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787841820.928924:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cc00ddc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874687714990592:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787841820.928989:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841820.929221:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714990592 00000100:00100000:0.0:1787841820.929231:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714990592 00000100:00100000:0.0:1787841820.929298:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787841820.929309:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cc00ddf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1874687714990592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787841820.929336:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:0.0:1787841820.929388:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cc00ddf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1874687714990592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841820.929397:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787841820.929449:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cc00ddc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874687714990592:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787841820.930251:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695055104 00000100:00100000:3.0:1787841820.930259:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695055104 00000100:00100000:2.0:1787841820.930485:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 126 00000100:00100000:2.0:1787841820.930494:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd5afc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+15:10557:x1874687695055104:12345-192.168.201.1@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787841820.930571:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104600/0xe3dac0c99affeb5f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841820.930801:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105c00/0xe3dac0c99affeb19 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d696a expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841820.930810:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104600/0xe3dac0c99affeb5f lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841820.930842:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105c00/0xe3dac0c99affeb19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d696a expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841820.930856:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105c00/0xe3dac0c99affeb19 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d696a expref: 15 pid: 5838 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841820.930871:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cc00ddc000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1874687714990720:192.168.201.1@tcp:104: 00000100:00100000:2.0:1787841820.930949:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc81933c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787841820.931454:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e2e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1874687714991104:0@lo:400:kworker.0 00000100:00100000:3.0:1787841820.931536:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841820.931605:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e2c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1874687714991232:0@lo:400:kworker.0 00000100:00100000:2.0:1787841820.932371:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e2de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3301:1874687714990848:0@lo:400:kworker.0 00000100:00100000:2.0:1787841820.932414:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841820.932543:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714990848 00000100:00100000:1.0:1787841820.932552:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714990848 00000100:00100000:1.0:1787841820.932679:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1787841820.932688:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:3301:x1874687714990848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841820.932777:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:3301:x1874687714990848:12345-0@lo:400:kworker.0 Request processed in 91us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841820.932784:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1787841820.932833:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e2de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3301:1874687714990848:0@lo:400:kworker.0 00000100:00100000:0.0:1787841820.933294:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714991104 00000100:00100000:0.0:1787841820.933301:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714991104 00000100:00100000:0.0:1787841820.933318:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e2f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874687714990976:0@lo:400:kworker.0 00000100:00100000:2.0:1787841820.933355:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841820.933393:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714991232 00000100:00100000:2.0:1787841820.933397:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714991232 00000100:00100000:2.0:1787841820.933432:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787841820.933440:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbd4bae1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874687714991232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841820.933488:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbd4bae1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874687714991232:12345-0@lo:400:kworker.0 Request processed in 49us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841820.933495:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787841820.933548:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e2c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1874687714991232:0@lo:400:kworker.0 00000100:00080000:2.0:1787841820.934365:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787841820.934417:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cc00ddc000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1874687714990720:192.168.201.1@tcp:104: 00010000:00010000:2.0:1787841820.934443:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104600/0xe3dac0c99affeb5f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841820.934874:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841820.934965:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787841820.934982:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e2ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874687714991104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841820.935050:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e2ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874687714991104:12345-0@lo:400:kworker.0 Request processed in 74us (3529us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841820.935366:0:9449:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1787841820.935375:0:9449:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:2.0:1787841820.935694:0:5839:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1787841820.935720:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714990976 00000100:00100000:2.0:1787841820.935726:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714990976 00000100:00100000:2.0:1787841820.935749:0:5839:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1787841820.935756:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787841820.935762:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd5ad2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874687714990976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841820.935819:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd5ad2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874687714990976:12345-0@lo:400:kworker.0 Request processed in 57us (946us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841820.935826:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787841820.935911:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e2f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874687714990976:0@lo:400:kworker.0 00000100:00100000:1.0:1787841820.935979:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787841820.936094:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e2e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1874687714991104:0@lo:400:kworker.0 00000100:00100000:0.0:1787841820.946197:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841820.946291:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695055232 00000100:00100000:3.0:1787841820.946303:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695055232 00010000:00010000:3.0:1787841820.946356:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105c00/0xe3dac0c99affeb19 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d696a expref: 16 pid: 5838 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841820.946404:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 56 00000100:00100000:3.0:1787841820.946415:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e66580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b2767a54-6703-4908-8414-eab6601e2ceb+16:2357:x1874687695055232:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787841820.946432:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787841820.946457:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105c00/0xe3dac0c99affeb19 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d696a expref: 16 pid: 5838 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841820.946597:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105c00/0xe3dac0c99affeb19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d696a expref: 16 pid: 5838 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841820.946621:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105c00/0xe3dac0c99affeb19 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d696a expref: 16 pid: 5838 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841820.946636:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff92cbc3b04400) 00010000:00010000:3.0:1787841820.946641:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104600/0xe3dac0c99affeb5f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841820.946650:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104600/0xe3dac0c99affeb5f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841820.946669:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104600/0xe3dac0c99affeb5f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841820.946747:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787841820.946805:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e66580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b2767a54-6703-4908-8414-eab6601e2ceb+15:2357:x1874687695055232:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 391us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841820.946813:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 56 00010000:00010000:2.0:1787841820.947365:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104600/0xe3dac0c99affeb5f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841820.947376:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104600/0xe3dac0c99affeb5f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841820.947404:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104600/0xe3dac0c99affeb5f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841820.947411:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104600/0xe3dac0c99affeb5f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841820.947419:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104600/0xe3dac0c99affeb5f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841820.947425:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6104600 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:2.0:1787841820.947429:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104600/0xe3dac0c99affeb5f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841820.947462:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104600/0xe3dac0c99affeb5f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841820.947474:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff92cbc3b04400) 00010000:00010000:2.0:1787841820.947476:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787841820.947480:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104600/0xe3dac0c99affeb5f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841820.947486:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104600/0xe3dac0c99affeb5f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841820.947545:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd5afc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+14:10557:x1874687695055104:12345-192.168.201.1@tcp:55:lhsmtool_posix.0 Request processed in 17051us (18868us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787841820.947554:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 126 00000100:00100000:0.0:1787841820.968350:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841820.968470:0:9572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695055360 00000100:00100000:2.0:1787841820.968481:0:9572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695055360 00000100:00100000:2.0:1787841820.968547:0:9572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 46 00000100:00100000:2.0:1787841820.968559:0:9572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e65680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b2767a54-6703-4908-8414-eab6601e2ceb+7:2356:x1874687695055360:12345-192.168.201.1@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787841820.968609:0:9572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008c2db5b8/0xe3dac0c99affeb66 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841820.968631:0:9572:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000095d604af/0xe3dac0c99affeb43 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6986 expref: 7 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841820.968639:0:9572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787841820.968644:0:9572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787841820.968648:0:9572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c2db5b8/0xe3dac0c99affeb66 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841820.968745:0:9572:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000095d604af/0xe3dac0c99affeb43 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6986 expref: 7 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841820.968760:0:9572:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000095d604af/0xe3dac0c99affeb43 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6986 expref: 7 pid: 6686 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841820.968775:0:9572:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4bad2c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9572:1874687714991360:192.168.201.1@tcp:104: 00000100:00100000:2.0:1787841820.968851:0:9572:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc81933c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787841820.978925:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841820.979032:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695055488 00000100:00100000:0.0:1787841820.979041:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695055488 00010000:00010000:0.0:1787841820.979083:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000095d604af/0xe3dac0c99affeb43 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6986 expref: 8 pid: 6686 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841820.979163:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 57 00000100:00100000:0.0:1787841820.979173:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e2d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b2767a54-6703-4908-8414-eab6601e2ceb+8:2357:x1874687695055488:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787841820.979194:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787841820.979223:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000095d604af/0xe3dac0c99affeb43 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6986 expref: 8 pid: 6686 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841820.979238:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000095d604af/0xe3dac0c99affeb43 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6986 expref: 8 pid: 6686 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841820.979268:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787841820.979272:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787841820.979279:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008c2db5b8/0xe3dac0c99affeb66 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 9572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841820.979290:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c2db5b8/0xe3dac0c99affeb66 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 9572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841820.979311:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787841820.979372:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e2d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b2767a54-6703-4908-8414-eab6601e2ceb+8:2357:x1874687695055488:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 200us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841820.979380:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 57 00010000:00010000:2.0:1787841820.980667:0:9572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095d604af/0xe3dac0c99affeb43 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6986 expref: 7 pid: 6686 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841820.980768:0:9572:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4bad2c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9572:1874687714991360:192.168.201.1@tcp:104: 00010000:00010000:2.0:1787841820.980800:0:9572:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008c2db5b8/0xe3dac0c99affeb66 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841820.980815:0:9572:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008c2db5b8/0xe3dac0c99affeb66 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841820.980823:0:9572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c2db5b8/0xe3dac0c99affeb66 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841820.980861:0:9572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008c2db5b8/0xe3dac0c99affeb66 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841820.980896:0:9572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c2db5b8/0xe3dac0c99affeb66 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841820.980906:0:9572:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008c2db5b8/0xe3dac0c99affeb66 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841820.980914:0:9572:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6104600 already unused, calling callback (ffffffffc17a4500) 00010000:00010000:2.0:1787841820.980919:0:9572:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008c2db5b8/0xe3dac0c99affeb66 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841820.980928:0:9572:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008c2db5b8/0xe3dac0c99affeb66 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841820.980949:0:9572:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008c2db5b8/0xe3dac0c99affeb66 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841820.980957:0:9572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c2db5b8/0xe3dac0c99affeb66 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841820.981064:0:9572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e65680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b2767a54-6703-4908-8414-eab6601e2ceb+6:2356:x1874687695055360:12345-192.168.201.1@tcp:1:lhsmtool_posix.0 Request processed in 12507us (12726us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841820.981074:0:9572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 46 00000100:00100000:3.0:1787841820.984807:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841820.985059:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695055744 00000100:00100000:2.0:1787841820.985069:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695055744 00000100:00100000:2.0:1787841820.985390:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 127 00000100:00100000:2.0:1787841820.985415:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e2e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+14:10557:x1874687695055744:12345-192.168.201.1@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787841820.985508:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105600/0xe3dac0c99affeb6d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841820.985527:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105600/0xe3dac0c99affeb6d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841820.985539:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105600/0xe3dac0c99affeb6d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841820.985791:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105e00/0xe3dac0c99affeb74 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841820.985803:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affeb27 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6971 expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841820.985811:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105e00/0xe3dac0c99affeb74 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841820.985844:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affeb27 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6971 expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841820.985857:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affeb27 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6971 expref: 15 pid: 5837 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841820.985871:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4bad2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1874687714991488:192.168.201.1@tcp:104: 00000100:00100000:2.0:1787841820.985963:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc81933c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787841820.989570:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4bad2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1874687714991488:192.168.201.1@tcp:104: 00010000:00010000:2.0:1787841820.989606:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105e00/0xe3dac0c99affeb74 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841820.994890:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841820.994984:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695055872 00000100:00100000:0.0:1787841820.994994:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695055872 00010000:00010000:0.0:1787841820.995034:0:7632:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affeb27 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6971 expref: 16 pid: 5837 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841820.995091:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 58 00000100:00100000:0.0:1787841820.995100:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e2e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b2767a54-6703-4908-8414-eab6601e2ceb+16:2357:x1874687695055872:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787841820.995114:0:7632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787841820.995121:0:7632:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affeb27 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6971 expref: 16 pid: 5837 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841820.995133:0:7632:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affeb27 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6971 expref: 16 pid: 5837 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841820.995163:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affeb27 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6971 expref: 16 pid: 5837 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841820.995181:0:7632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff92cbc3b04400) 00010000:00010000:0.0:1787841820.995186:0:7632:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105e00/0xe3dac0c99affeb74 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841820.995196:0:7632:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105e00/0xe3dac0c99affeb74 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841820.995204:0:7632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105e00/0xe3dac0c99affeb74 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841820.995232:0:7632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787841820.995288:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e2e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b2767a54-6703-4908-8414-eab6601e2ceb+15:2357:x1874687695055872:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 189us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841820.995295:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 58 00010000:00010000:2.0:1787841820.995401:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105e00/0xe3dac0c99affeb74 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841820.995409:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105e00/0xe3dac0c99affeb74 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787841820.995606:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:2.0:1787841820.995782:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:2.0:1787841820.995822:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:2.0:1787841820.995890:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4bad2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5839:1874687714991616:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787841820.995935:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841820.995956:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbe19600c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787841820.996941:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714991616 00000100:00100000:0.0:1787841820.996962:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714991616 00000100:00100000:0.0:1787841820.997014:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787841820.997023:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cc00ddc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5839:x1874687714991616:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787841820.997119:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cc00ddc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5839:x1874687714991616:12345-0@lo:1000:mdt00_002.0 Request processed in 98us (1183us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841820.997126:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787841820.997182:0:5839:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1787841820.997188:0:5839:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967310 00000004:00080000:0.0:1787841820.997206:0:5839:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff92cc00ddda40, transno 4294967309 00000004:00080000:0.0:1787841820.997214:0:5839:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff92cc00ddd680, transno 4294967310 00000100:00100000:0.0:1787841820.997220:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4bad2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5839:1874687714991616:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1787841820.997796:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:0.0:1787841820.997872:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4bad2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5839:1874687714991744:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787841820.997919:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841820.997943:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc81933c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787841820.997960:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714991744 00000100:00100000:0.0:1787841820.997964:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714991744 00000100:00100000:0.0:1787841820.997987:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787841820.997993:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff3eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5839:x1874687714991744:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787841820.998157:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff3eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5839:x1874687714991744:12345-0@lo:1000:mdt00_002.0 Request processed in 164us (237us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1787841820.998164:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787841820.998197:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4bad2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5839:1874687714991744:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1787841820.998229:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105e00/0xe3dac0c99affeb74 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841820.998239:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105e00/0xe3dac0c99affeb74 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841820.998253:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105e00/0xe3dac0c99affeb74 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841820.998260:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6105e00 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:0.0:1787841820.998264:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105e00/0xe3dac0c99affeb74 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841820.998272:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105e00/0xe3dac0c99affeb74 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841820.998288:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff92cbc3b04400) 00010000:00010000:0.0:1787841820.998291:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787841820.998296:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105e00/0xe3dac0c99affeb74 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841820.998302:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105e00/0xe3dac0c99affeb74 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841820.998336:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105800/0xe3dac0c99affeab7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841820.998342:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105800/0xe3dac0c99affeab7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841820.998348:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105800/0xe3dac0c99affeab7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841820.998353:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6105800 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:0.0:1787841820.998355:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105800/0xe3dac0c99affeab7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841820.998371:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105800/0xe3dac0c99affeab7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841820.998380:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92cbc3b04b00) 00010000:00010000:0.0:1787841820.998382:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787841820.998389:0:5839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b800/0xe3dac0c99affeabe lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6955 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841820.998400:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b800/0xe3dac0c99affeabe lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6955 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841820.998408:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b800/0xe3dac0c99affeabe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6955 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841820.998433:0:5839:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b800/0xe3dac0c99affeabe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6955 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841820.998444:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff3e9a40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1874687714991872:192.168.201.1@tcp:105: 00000100:00100000:0.0:1787841820.998514:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbe19600c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787841821.011836:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841821.011955:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695056000 00000100:00100000:2.0:1787841821.011969:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695056000 00000100:00100000:2.0:1787841821.012075:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 31 00000100:00100000:2.0:1787841821.012086:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e2f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b2767a54-6703-4908-8414-eab6601e2ceb+19:10556:x1874687695056000:12345-192.168.201.1@tcp:49:lfs.0 00000100:00100000:2.0:1787841821.012265:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e2f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b2767a54-6703-4908-8414-eab6601e2ceb+19:10556:x1874687695056000:12345-192.168.201.1@tcp:49:lfs.0 Request processed in 181us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841821.012273:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 31 00000100:00100000:0.0:1787841821.012606:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff3e9a40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1874687714991872:192.168.201.1@tcp:105: 00010000:00010000:0.0:1787841821.012637:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105800/0xe3dac0c99affeab7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841821.012647:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105800/0xe3dac0c99affeab7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841821.012691:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3ae00/0xe3dac0c99affeb7b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841821.012769:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3ae00/0xe3dac0c99affeb7b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841821.012784:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3ae00/0xe3dac0c99affeb7b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841821.012795:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3ae00/0xe3dac0c99affeb7b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841821.012801:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3ae00/0xe3dac0c99affeb7b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841821.012807:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3ae00/0xe3dac0c99affeb7b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841821.012813:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbffa3ae00 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:0.0:1787841821.012817:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3ae00/0xe3dac0c99affeb7b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841821.012823:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3ae00/0xe3dac0c99affeb7b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841821.012834:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92cbc3b04b00) 00010000:00010000:0.0:1787841821.012838:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841821.012842:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3ae00/0xe3dac0c99affeb7b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841821.012848:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3ae00/0xe3dac0c99affeb7b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841821.012859:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105600/0xe3dac0c99affeb6d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841821.012870:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105600/0xe3dac0c99affeb6d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841821.012875:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105600/0xe3dac0c99affeb6d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841821.012879:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6105600 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:0.0:1787841821.012881:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105600/0xe3dac0c99affeb6d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841821.012887:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105600/0xe3dac0c99affeb6d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841821.012894:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92cbc3b04b00) 00010000:00010000:0.0:1787841821.012897:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787841821.012899:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105600/0xe3dac0c99affeb6d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841821.012904:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105600/0xe3dac0c99affeb6d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841821.013258:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e2e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+18:10557:x1874687695055744:12345-192.168.201.1@tcp:57:lhsmtool_posix.0 Request processed in 27725us (28345us total) trans 4294967406 rc 0/0 00000100:00100000:0.0:1787841821.013270:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 127 00000020:00080000:0.0:1787841821.013275:0:5839:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1787841821.013952:0:11682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787841821.013959:0:11682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787841821.014610:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1787841821.014622:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00080000:3.0:1787841821.014880:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787841821.025113:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841821.025402:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695056256 00000100:00100000:1.0:1787841821.025413:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695056256 00000100:00100000:1.0:1787841821.025488:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 128 00000100:00100000:1.0:1787841821.025498:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e2c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+18:10556:x1874687695056256:12345-192.168.201.1@tcp:58:lfs.0 00000040:00080000:1.0:1787841821.025935:0:9449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:1.0:1787841821.026036:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e2c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+18:10556:x1874687695056256:12345-192.168.201.1@tcp:58:lfs.0 Request processed in 539us (935us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841821.026045:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 128 00000100:00100000:0.0:1787841821.028348:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841821.030259:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695056512 00000100:00100000:1.0:1787841821.030273:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695056512 00000100:00100000:1.0:1787841821.030356:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 32 00000100:00100000:1.0:1787841821.030368:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbc6c32050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b2767a54-6703-4908-8414-eab6601e2ceb+18:10557:x1874687695056512:12345-192.168.201.1@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1787841821.032303:0:5841:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787841821.032418:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:1.0:1787841821.032482:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99affeb82 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841821.032510:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99affeb82 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841821.032527:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99affeb82 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841821.032537:0:5841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99affeb82 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841821.032543:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99affeb82 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841821.032549:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99affeb82 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841821.032582:0:5841:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787841821.033130:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787841821.033148:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99affeb82 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841821.033156:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cc00d9d400 already unused, calling callback (ffffffffc17a4500) 00010000:00010000:2.0:1787841821.033167:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99affeb82 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841821.033177:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99affeb82 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841821.033191:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff92cbd1fc7b00) 00010000:00010000:2.0:1787841821.033194:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787841821.033198:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99affeb82 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841821.033204:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99affeb82 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841821.033221:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841821.033222:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841821.033224:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787841821.035842:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbc6c32050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b2767a54-6703-4908-8414-eab6601e2ceb+20:10557:x1874687695056512:12345-192.168.201.1@tcp:35:lhsmtool_posix.0 Request processed in 5463us (7489us total) trans 4294967408 rc 0/0 00000100:00100000:1.0:1787841821.035857:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 32 00000020:00080000:1.0:1787841821.035867:0:5841:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787841821.107650:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841821.107796:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695056640 00000100:00100000:2.0:1787841821.107806:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695056640 00000100:00100000:2.0:1787841821.107867:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 129 00000100:00100000:2.0:1787841821.107876:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff3e9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+20:10559:x1874687695056640:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:2.0:1787841821.107903:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841821.107924:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104600/0xe3dac0c99affeb89 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d698d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841821.107990:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104800/0xe3dac0c99affeb90 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841821.108006:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104800/0xe3dac0c99affeb90 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841821.108017:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104800/0xe3dac0c99affeb90 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841821.108054:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104200/0xe3dac0c99affeb97 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841821.108061:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104200/0xe3dac0c99affeb97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841821.108068:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104200/0xe3dac0c99affeb97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841821.108379:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105600/0xe3dac0c99affeb9e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841821.108392:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affeaa9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d694e expref: 21 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841821.108400:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105600/0xe3dac0c99affeb9e lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841821.108444:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affeaa9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d694e expref: 21 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841821.108459:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affeaa9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d694e expref: 21 pid: 9449 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841821.108474:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cc00ddda40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1874687714992000:192.168.201.1@tcp:104: 00000100:00100000:2.0:1787841821.108568:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc6555cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787841821.112769:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cc00ddda40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1874687714992000:192.168.201.1@tcp:104: 00010000:00010000:2.0:1787841821.112805:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105600/0xe3dac0c99affeb9e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841821.114034:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841821.114409:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695056896 00000100:00100000:2.0:1787841821.114418:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695056896 00000100:00100000:2.0:1787841821.114498:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 33 00000100:00100000:2.0:1787841821.114508:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff42ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b2767a54-6703-4908-8414-eab6601e2ceb+22:5605:x1874687695056896:12345-192.168.201.1@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787841821.114811:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff42ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b2767a54-6703-4908-8414-eab6601e2ceb+23:5605:x1874687695056896:12345-192.168.201.1@tcp:35:ldlm_bl.0 Request processed in 304us (784us total) trans 4294967409 rc 0/0 00000100:00100000:2.0:1787841821.114819:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 33 00000100:00100000:3.0:1787841821.121428:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841821.121917:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695057024 00000100:00100000:0.0:1787841821.121929:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695057024 00010000:00010000:0.0:1787841821.121987:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affeaa9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d694e expref: 23 pid: 9449 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841821.122036:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 59 00000100:00100000:0.0:1787841821.122047:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e2de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b2767a54-6703-4908-8414-eab6601e2ceb+23:2357:x1874687695057024:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787841821.122075:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787841821.122083:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affeaa9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d694e expref: 23 pid: 9449 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841821.122097:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affeaa9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d694e expref: 23 pid: 9449 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841821.122123:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affeaa9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d694e expref: 23 pid: 9449 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841821.122151:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92cbc3b04b00) 00010000:00010000:0.0:1787841821.122158:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105600/0xe3dac0c99affeb9e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841821.122167:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105600/0xe3dac0c99affeb9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841821.122177:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105600/0xe3dac0c99affeb9e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841821.122204:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787841821.122265:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e2de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b2767a54-6703-4908-8414-eab6601e2ceb+22:2357:x1874687695057024:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 220us (847us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841821.122273:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 59 00010000:00010000:2.0:1787841821.124617:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105600/0xe3dac0c99affeb9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841821.124634:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105600/0xe3dac0c99affeb9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787841821.124734:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1787841821.124739:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787841821.124760:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105600/0xe3dac0c99affeb9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841821.124776:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105600/0xe3dac0c99affeb9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841821.124787:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104800/0xe3dac0c99affeb90 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841821.124794:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104800/0xe3dac0c99affeb90 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841821.124802:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104800/0xe3dac0c99affeb90 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841821.124829:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6104800 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:2.0:1787841821.124835:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104800/0xe3dac0c99affeb90 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841821.124845:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104800/0xe3dac0c99affeb90 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841821.124865:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92cbd1fc7300) 00010000:00010000:2.0:1787841821.124876:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787841821.124881:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104800/0xe3dac0c99affeb90 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841821.124888:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104800/0xe3dac0c99affeb90 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841821.124904:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104200/0xe3dac0c99affeb97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841821.124911:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104200/0xe3dac0c99affeb97 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841821.124917:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104200/0xe3dac0c99affeb97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841821.124922:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6104200 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:2.0:1787841821.124924:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104200/0xe3dac0c99affeb97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841821.124930:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104200/0xe3dac0c99affeb97 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841821.124945:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff92cbc3b04c00) 00010000:00010000:2.0:1787841821.124948:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787841821.124951:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104200/0xe3dac0c99affeb97 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841821.124956:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104200/0xe3dac0c99affeb97 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841821.125001:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104600/0xe3dac0c99affeb89 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d698d expref: 22 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841821.125014:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105600/0xe3dac0c99affeb9e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d698d expref: 21 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841821.125022:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92cbc3b04b00) 00010000:00010000:2.0:1787841821.125024:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787841821.125027:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc6105600, rc 0) 00000100:00100000:2.0:1787841821.125105:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff3e9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+21:10559:x1874687695056640:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 17229us (17465us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841821.125114:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 129 00010000:00010000:2.0:1787841821.248899:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787841821.954192:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787841821.954230:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbe99c6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874687714992128:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787841821.954327:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841821.954840:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714992128 00000100:00100000:1.0:1787841821.954855:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714992128 00000100:00100000:1.0:1787841821.954938:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787841821.954950:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff42e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1874687714992128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787841821.954989:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:1.0:1787841821.955072:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff42e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1874687714992128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 124us (745us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841821.955082:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787841821.955965:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbe99c6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874687714992128:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1787841822.016985:0:11682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787841822.016997:0:11682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787841822.017046:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1787841822.017052:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787841822.017282:0:11682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cc00ddd680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11682:1874687714992256:192.168.201.1@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787841822.020219:0:11682:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc65550c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787841822.033073:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841822.033083:0:11682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cc00ddd680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11682:1874687714992256:192.168.201.1@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787841822.033285:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695057152 00000100:00100000:0.0:1787841822.033293:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695057152 00000100:00100000:0.0:1787841822.033479:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 130 00000100:00100000:0.0:1787841822.033490:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe99c61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+21:10570:x1874687695057152:12345-192.168.201.1@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787841822.033554:0:5839:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787841822.033743:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe99c61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+21:10570:x1874687695057152:12345-192.168.201.1@tcp:53:lhsmtool_posix.0 Request processed in 253us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841822.033751:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 130 00000100:00100000:3.0:1787841822.050871:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841822.051097:0:12018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695057408 00000100:00100000:2.0:1787841822.051111:0:12018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695057408 00000100:00100000:2.0:1787841822.051183:0:12018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 131 00000100:00100000:2.0:1787841822.051196:0:12018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e2f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b2767a54-6703-4908-8414-eab6601e2ceb+21:10570:x1874687695057408:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787841822.051233:0:12018:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841822.051261:0:12018:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105800/0xe3dac0c99affeba5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6994 expref: -99 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841822.051432:0:12018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105e00/0xe3dac0c99affebac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841822.051453:0:12018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105e00/0xe3dac0c99affebac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841822.051472:0:12018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105e00/0xe3dac0c99affebac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787841822.051488:0:12018:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787841822.051680:0:12018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105800/0xe3dac0c99affeba5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6994 expref: 24 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841822.051734:0:12018:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105e00/0xe3dac0c99affebac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6994 expref: 23 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841822.051744:0:12018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92cbc3b04b00) 00010000:00010000:2.0:1787841822.051748:0:12018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787841822.051752:0:12018:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc6105e00, rc 0) 00000100:00100000:2.0:1787841822.051833:0:12018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e2f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b2767a54-6703-4908-8414-eab6601e2ceb+23:10570:x1874687695057408:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 Request processed in 640us (978us total) trans 4294967410 rc 0/0 00000100:00100000:2.0:1787841822.051864:0:12018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 131 00000100:00100000:2.0:1787841822.057429:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841822.057729:0:7633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695057536 00000100:00100000:3.0:1787841822.057742:0:7633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695057536 00000100:00100000:3.0:1787841822.057828:0:7633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 8 00000100:00100000:3.0:1787841822.057840:0:7633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cc00ddd680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b2767a54-6703-4908-8414-eab6601e2ceb+23:2354:x1874687695057536:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787841822.057860:0:7633:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787841822.057907:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105e00/0xe3dac0c99affebac lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6994 expref: 23 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841822.057937:0:7633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92cbc3b04b00) 00010000:00010000:3.0:1787841822.057946:0:7633:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787841822.058032:0:7633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cc00ddd680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b2767a54-6703-4908-8414-eab6601e2ceb+22:2354:x1874687695057536:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 195us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841822.058042:0:7633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 8 00000100:00100000:3.0:1787841822.064253:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841822.064572:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695057792 00000100:00100000:0.0:1787841822.064586:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695057792 00000100:00100000:0.0:1787841822.064673:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 132 00000100:00100000:0.0:1787841822.064689:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf04c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+22:10570:x1874687695057792:12345-192.168.201.1@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787841822.064834:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3bc00/0xe3dac0c99affebba lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841822.064856:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3bc00/0xe3dac0c99affebba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841822.064882:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3bc00/0xe3dac0c99affebba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841822.065146:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3bc00/0xe3dac0c99affebba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841822.065174:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3bc00/0xe3dac0c99affebba lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841822.065182:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3bc00/0xe3dac0c99affebba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841822.065188:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbffa3bc00 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:0.0:1787841822.065193:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3bc00/0xe3dac0c99affebba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841822.065201:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3bc00/0xe3dac0c99affebba lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841822.065216:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92cbc3b04b00) 00010000:00010000:0.0:1787841822.065219:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787841822.065225:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3bc00/0xe3dac0c99affebba lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841822.065231:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3bc00/0xe3dac0c99affebba lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841822.065431:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf04c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+23:10570:x1874687695057792:12345-192.168.201.1@tcp:57:lhsmtool_posix.0 Request processed in 743us (1194us total) trans 4294967411 rc 0/0 00000100:00100000:0.0:1787841822.065441:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 132 00000040:00080000:0.0:1787841822.065597:0:11682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787841822.065603:0:11682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787841822.066153:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1787841822.066163:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787841822.072333:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841822.072413:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695058048 00000100:00100000:3.0:1787841822.072426:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695058048 00000100:00100000:3.0:1787841822.072495:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 34 00000100:00100000:3.0:1787841822.072505:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cc00dde940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b2767a54-6703-4908-8414-eab6601e2ceb+23:10570:x1874687695058048:12345-192.168.201.1@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787841822.073285:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cc00dde940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b2767a54-6703-4908-8414-eab6601e2ceb+24:10570:x1874687695058048:12345-192.168.201.1@tcp:35:lhsmtool_posix.0 Request processed in 776us (965us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1787841822.073296:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 34 00000040:00080000:1.0:1787841822.146307:0:12056:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787841822.146321:0:12056:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787841822.146372:0:12056:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1787841822.146380:0:12056:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787841822.279082:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787841822.416849:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841822.417572:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695058304 00000100:00100000:3.0:1787841822.417590:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695058304 00000100:00100000:3.0:1787841822.417726:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 133 00000100:00100000:3.0:1787841822.417741:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cc00dded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+24:10583:x1874687695058304:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:3.0:1787841822.417785:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841822.417818:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149de00/0xe3dac0c99affebc1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d699b expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841822.417986:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149cc00/0xe3dac0c99affebc8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841822.418007:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149cc00/0xe3dac0c99affebc8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841822.418023:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149cc00/0xe3dac0c99affebc8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787841822.418039:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1787841822.418217:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149de00/0xe3dac0c99affebc1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d699b expref: 27 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841822.418240:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149cc00/0xe3dac0c99affebc8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d699b expref: 26 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841822.418249:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92cbc3b04b00) 00010000:00010000:3.0:1787841822.419462:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787841822.419471:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc149cc00, rc 0) 00000100:00100000:3.0:1787841822.419625:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cc00dded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+26:10583:x1874687695058304:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 1884us (2789us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1787841822.419648:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 133 00000100:00100000:2.0:1787841822.450107:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841822.450158:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695058432 00000100:00100000:2.0:1787841822.450170:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695058432 00000100:00100000:2.0:1787841822.450241:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 134 00000100:00100000:2.0:1787841822.450253:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6ca6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2767a54-6703-4908-8414-eab6601e2ceb+26:10583:x1874687695058432:12345-192.168.201.1@tcp:54:lfs.0 00010000:00010000:2.0:1787841822.451253:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105200/0xe3dac0c99affebd6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841822.451818:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105200/0xe3dac0c99affebd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841822.451836:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105200/0xe3dac0c99affebd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841822.451870:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105200/0xe3dac0c99affebd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841822.451878:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105200/0xe3dac0c99affebd6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841822.451886:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105200/0xe3dac0c99affebd6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841822.451892:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6105200 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:2.0:1787841822.451897:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105200/0xe3dac0c99affebd6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841822.453611:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105200/0xe3dac0c99affebd6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841822.453649:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92cbc3b04b00) 00010000:00010000:2.0:1787841822.453653:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787841822.453660:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105200/0xe3dac0c99affebd6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841822.453668:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105200/0xe3dac0c99affebd6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841822.453810:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6ca6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2767a54-6703-4908-8414-eab6601e2ceb+26:10583:x1874687695058432:12345-192.168.201.1@tcp:54:lfs.0 Request processed in 3551us (3706us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841822.453822:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 134 00000100:00100000:2.0:1787841822.706851:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841822.707298:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695058560 00000100:00100000:0.0:1787841822.707314:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695058560 00000100:00100000:0.0:1787841822.708236:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 47 00000100:00100000:0.0:1787841822.708260:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6ca4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b2767a54-6703-4908-8414-eab6601e2ceb+6:2355:x1874687695058560:12345-192.168.201.1@tcp:101:cat.0 00010000:00010000:0.0:1787841822.708289:0:6686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841822.708322:0:6686:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7800b92/0xe3dac0c99affebdd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d69a2 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787841822.708365:0:6686:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a904d1c, atime: 0x6a904d1b, ctime: 0x6a904d1c, blocks: 0xb 00010000:00010000:0.0:1787841822.708398:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=362s v=(0 0) 00000100:00080000:3.0:1787841822.708669:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787841822.708810:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787841822.708826:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7800b92/0xe3dac0c99affebdd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d69a2 expref: 7 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841822.708859:0:6686:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d7800b92/0xe3dac0c99affebdd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d69a2 expref: 7 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841822.708876:0:6686:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbffa3b200, rc 0) 00000100:00100000:0.0:1787841822.709146:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6ca4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b2767a54-6703-4908-8414-eab6601e2ceb+7:2355:x1874687695058560:12345-192.168.201.1@tcp:101:cat.0 Request processed in 896us (2311us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841822.709164:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 47 00000100:00100000:2.0:1787841822.713001:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841822.713294:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695058688 00000100:00100000:3.0:1787841822.713311:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695058688 00002000:00100000:3.0:1787841822.713388:0:6693:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff92cbf6ca70c0 x1874687695058688/t0(0) o3->b2767a54-6703-4908-8414-eab6601e2ceb@192.168.201.1@tcp:323/0 lens 488/0 e 0 to 0 dl 1787841833 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787841822.713402:0:6693:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff92cbf6ca70c0 with x1874687695058688 ext(0->4095) 00002000:00010000:3.0:1787841822.713516:0:6693:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92cbf6ca70c0 00000100:00100000:3.0:1787841822.713669:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 3 00000100:00100000:3.0:1787841822.713683:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6ca70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b2767a54-6703-4908-8414-eab6601e2ceb+7:2354:x1874687695058688:12345-192.168.201.1@tcp:3:cat.0 00000100:00100000:3.0:1787841822.714445:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6ca70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b2767a54-6703-4908-8414-eab6601e2ceb+7:2354:x1874687695058688:12345-192.168.201.1@tcp:3:cat.0 Request processed in 760us (1470us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787841822.714456:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 3 00002000:00100000:3.0:1787841822.714467:0:6693:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff92cbf6ca70c0 x1874687695058688/t0(0) o3->b2767a54-6703-4908-8414-eab6601e2ceb@192.168.201.1@tcp:323/0 lens 488/4536 e 0 to 0 dl 1787841833 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787841822.714477:0:6693:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff92cbf6ca70c0 with x1874687695058688 ext(0->4095) 00002000:00010000:3.0:1787841822.714482:0:6693:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92cbf6ca70c0 00000100:00100000:2.0:1787841822.865469:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841822.865616:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841822.865671:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841822.865765:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841822.865795:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841822.865922:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695058816 00000100:00100000:3.0:1787841822.865939:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695058816 00000100:00100000:3.0:1787841822.866550:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 300 00000100:00100000:3.0:1787841822.866569:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a1f1ce-26b5-4cc6-a1db-8e09063432da+13:2354:x1874687695058816:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:3.0:1787841822.866691:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a1f1ce-26b5-4cc6-a1db-8e09063432da+13:2354:x1874687695058816:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 127us (1017us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841822.866740:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 300 00000100:00100000:3.0:1787841822.866812:0:9572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695059200 00000100:00100000:3.0:1787841822.866817:0:9572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695059200 00000100:00100000:3.0:1787841822.866862:0:9572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695059072 00000100:00100000:3.0:1787841822.866865:0:9572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695059072 00000100:00100000:3.0:1787841822.866913:0:9572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 67 00000100:00100000:3.0:1787841822.866921:0:9572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbd4a9f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b2767a54-6703-4908-8414-eab6601e2ceb+5:2354:x1874687695059200:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:3.0:1787841822.866960:0:9572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbd4a9f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b2767a54-6703-4908-8414-eab6601e2ceb+5:2354:x1874687695059200:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 41us (1358us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841822.866967:0:9572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 67 00000100:00100000:3.0:1787841822.868455:0:9572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 68 00000100:00100000:3.0:1787841822.868490:0:9572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf04c0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b2767a54-6703-4908-8414-eab6601e2ceb+7:2354:x1874687695059072:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:3.0:1787841822.868577:0:9572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf04c0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b2767a54-6703-4908-8414-eab6601e2ceb+7:2354:x1874687695059072:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 108us (2811us total) trans 0 rc 0/0 00000100:00080000:0.0:1787841822.872727:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787841822.873336:0:9572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 68 00000100:00100000:1.0:1787841822.879582:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695058944 00000100:00100000:1.0:1787841822.886105:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695058944 00000100:00100000:1.0:1787841822.886240:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695059328 00000100:00100000:1.0:1787841822.886248:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695059328 00000100:00100000:1.0:1787841822.886322:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 158 00000100:00100000:1.0:1787841822.886336:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6ca43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+26:2354:x1874687695058944:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:1.0:1787841822.886474:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6ca43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+26:2354:x1874687695058944:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 140us (21021us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841822.886483:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 158 00000100:00100000:1.0:1787841822.886507:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 159 00000100:00080000:0.0:1787841822.886560:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787841822.887408:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf04c1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fe7d2185-ae43-428e-8bfa-909f60138853+5:2354:x1874687695059328:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:0.0:1787841822.898613:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf04c1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fe7d2185-ae43-428e-8bfa-909f60138853+5:2354:x1874687695059328:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 12075us (32792us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841822.898646:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 159 00010000:00010000:2.0:1787841823.297085:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841824.321229:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787841824.599353:0:7643:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00010000:00010000:2.0:1787841825.345855:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787841826.048961:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787841826.048989:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff42c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874687714992384:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787841826.049085:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841826.049190:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714992384 00000100:00100000:1.0:1787841826.049198:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714992384 00000100:00100000:1.0:1787841826.049271:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787841826.049282:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff42de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874687714992384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787841826.049319:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787841826.049370:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff42de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874687714992384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841826.049378:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787841826.049430:0:3299:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:1.0:1787841826.049437:0:3299:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff92cbf6e2da40, transno 4294967304 00000100:00100000:1.0:1787841826.049455:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff42c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874687714992384:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1787841826.055886:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787841826.059990:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff42c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874687714992640:0@lo:400:kworker.0 00000100:00100000:3.0:1787841826.060064:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841826.060109:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714992640 00000100:00100000:0.0:1787841826.060118:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714992640 00000100:00100000:3.0:1787841826.060122:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787841826.060131:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff42c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1874687714992768:0@lo:400:kworker.0 00000100:00100000:3.0:1787841826.060158:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841826.060239:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff42f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3299:1874687714992512:0@lo:400:kworker.0 00000100:00100000:0.0:1787841826.060256:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714992768 00000100:00100000:0.0:1787841826.060262:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714992768 00000100:00100000:1.0:1787841826.060281:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841826.060316:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf07f83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1874687714993024:0@lo:400:kworker.0 00000100:00100000:1.0:1787841826.060347:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841826.060368:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787841826.060374:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff42e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874687714992896:0@lo:400:kworker.0 00000100:00100000:1.0:1787841826.060398:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841826.060451:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714992512 00000100:00100000:1.0:1787841826.060455:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714992512 00000100:00100000:1.0:1787841826.060485:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1787841826.060493:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:3299:x1874687714992512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841826.060552:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:3299:x1874687714992512:12345-0@lo:400:kworker.0 Request processed in 58us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841826.060560:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1787841826.060611:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714992896 00000100:00100000:1.0:1787841826.060615:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714992896 00000100:00100000:1.0:1787841826.060648:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787841826.060655:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe99c7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3299:x1874687714992896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787841826.060821:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714993024 00000100:00100000:3.0:1787841826.060825:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714993024 00000100:00100000:3.0:1787841826.060849:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787841826.060856:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf04c43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874687714992640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787841826.060901:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf04c43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874687714992640:12345-0@lo:400:kworker.0 Request processed in 45us (837us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841826.060908:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787841826.060915:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787841826.060925:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1787841826.060930:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf04c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874687714992768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787841826.060938:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe99c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1874687714993024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841826.060980:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf04c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874687714992768:12345-0@lo:400:kworker.0 Request processed in 56us (820us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841826.060988:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787841826.060996:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe99c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1874687714993024:12345-0@lo:400:kworker.0 Request processed in 60us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841826.061005:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00080000:0.0:1787841826.061009:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787841826.061016:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787841826.061058:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff42c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1874687714992768:0@lo:400:kworker.0 00000100:00100000:3.0:1787841826.061069:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff42c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874687714992640:0@lo:400:kworker.0 00000100:00100000:0.0:1787841826.062086:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff42f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3299:1874687714992512:0@lo:400:kworker.0 00000100:00100000:0.0:1787841826.062105:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf07f83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1874687714993024:0@lo:400:kworker.0 00000100:00100000:1.0:1787841826.062845:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe99c7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3299:x1874687714992896:12345-0@lo:400:kworker.0 Request processed in 2187us (2442us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841826.062857:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787841826.063683:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff42e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874687714992896:0@lo:400:kworker.0 00000001:00080000:1.0:1787841826.112797:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967411 is committed 00000020:00080000:1.0:1787841826.112817:0:5860:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff92cbcdb29a80 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1787841826.112822:0:5860:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff92cbf6ed2d00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff92cbcdb29240 00000020:00080000:1.0:1787841826.112825:0:5860:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff92cbf6ed2000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff92cbff3c3000 00000020:00080000:1.0:1787841826.112854:0:5860:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000001:00080000:1.0:1787841826.112875:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:1.0:1787841826.112891:0:5871:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:1.0:1787841826.113111:0:5871:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:0.0:1787841826.122445:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:0.0:1787841826.122461:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00010000:00010000:3.0:1787841826.369522:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787841827.073161:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbe99c5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874687714993152:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787841827.073280:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841827.073553:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714993152 00000100:00100000:1.0:1787841827.073596:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714993152 00000100:00100000:1.0:1787841827.073662:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787841827.073671:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf04c7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874687714993152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787841827.073734:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787841827.073790:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf04c7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874687714993152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841827.073796:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787841827.074036:0:3300:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:3.0:1787841827.074043:0:3300:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:3.0:1787841827.074077:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbe99c5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874687714993152:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1787841827.203415:0:11682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787841827.203433:0:11682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787841827.203486:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1787841827.203496:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787841827.394052:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787841827.983459:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841827.983503:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841827.983535:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841827.983572:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841827.983596:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841827.983639:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695059584 00000100:00100000:3.0:1787841827.983651:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695059584 00000100:00100000:3.0:1787841827.983751:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695059968 00000100:00100000:3.0:1787841827.983755:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695059968 00000100:00100000:3.0:1787841827.983785:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 163 00000100:00100000:3.0:1787841827.983797:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbd4bad2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+13:2355:x1874687695059584:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:3.0:1787841827.983911:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbd4bad2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+13:2355:x1874687695059584:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 117us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841827.983939:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 163 00000100:00100000:3.0:1787841827.983963:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 164 00000100:00100000:3.0:1787841827.983970:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff42c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fe7d2185-ae43-428e-8bfa-909f60138853+5:2355:x1874687695059968:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:3.0:1787841827.984006:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff42c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fe7d2185-ae43-428e-8bfa-909f60138853+5:2355:x1874687695059968:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 36us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841827.984012:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 164 00000100:00100000:3.0:1787841827.984036:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695059840 00000100:00100000:3.0:1787841827.984040:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695059840 00000100:00100000:3.0:1787841827.984072:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695059712 00000100:00100000:3.0:1787841827.984075:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695059712 00000100:00100000:3.0:1787841827.984104:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 70 00000100:00100000:3.0:1787841827.984110:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff42e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b2767a54-6703-4908-8414-eab6601e2ceb+5:2355:x1874687695059840:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:3.0:1787841827.984142:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff42e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b2767a54-6703-4908-8414-eab6601e2ceb+5:2355:x1874687695059840:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 31us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841827.984149:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 70 00000100:00100000:3.0:1787841827.984160:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 71 00000100:00100000:3.0:1787841827.984166:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff42f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b2767a54-6703-4908-8414-eab6601e2ceb+6:2355:x1874687695059712:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:3.0:1787841827.984193:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff42f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b2767a54-6703-4908-8414-eab6601e2ceb+6:2355:x1874687695059712:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 27us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841827.984199:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 71 00000100:00100000:3.0:1787841827.984218:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695059456 00000100:00100000:3.0:1787841827.984221:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695059456 00000100:00100000:3.0:1787841827.984248:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 302 00000100:00100000:3.0:1787841827.984254:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a1f1ce-26b5-4cc6-a1db-8e09063432da+13:2355:x1874687695059456:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:3.0:1787841827.984289:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a1f1ce-26b5-4cc6-a1db-8e09063432da+13:2355:x1874687695059456:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 35us (753us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841827.984296:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 302 00000100:00080000:3.0:1787841827.984336:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787841827.984342:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787841827.984345:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787841828.417024:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787841828.625285:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841828.625433:0:12018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695060096 00000100:00100000:2.0:1787841828.625447:0:12018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695060096 00000100:00100000:2.0:1787841828.625555:0:12018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 135 00000100:00100000:2.0:1787841828.625567:0:12018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf07fb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b2767a54-6703-4908-8414-eab6601e2ceb+13:10244:x1874687695060096:12345-192.168.201.1@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1787841828.625780:0:12018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf07fb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b2767a54-6703-4908-8414-eab6601e2ceb+13:10244:x1874687695060096:12345-192.168.201.1@tcp:60:lhsmtool_posix.0 Request processed in 215us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841828.625789:0:12018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 135 00000100:00100000:3.0:1787841828.636539:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841828.636810:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695060352 00000100:00100000:2.0:1787841828.636826:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695060352 00000100:00100000:2.0:1787841828.636998:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 35 00000100:00100000:2.0:1787841828.637014:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff42c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b2767a54-6703-4908-8414-eab6601e2ceb+13:10244:x1874687695060352:12345-192.168.201.1@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787841828.637809:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff42c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b2767a54-6703-4908-8414-eab6601e2ceb+14:10244:x1874687695060352:12345-192.168.201.1@tcp:35:lhsmtool_posix.0 Request processed in 795us (1294us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1787841828.637819:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 35 00000100:00100000:0.0:1787841828.835907:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841828.836091:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695060480 00000100:00100000:3.0:1787841828.836105:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695060480 00000100:00100000:3.0:1787841828.836232:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 136 00000100:00100000:3.0:1787841828.836244:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf07f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fe7d2185-ae43-428e-8bfa-909f60138853+5:11037:x1874687695060480:12345-192.168.201.1@tcp:101:lsof.0 00010000:00010000:3.0:1787841828.836279:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841828.836325:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affebe4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d69a9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841828.836420:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149de00/0xe3dac0c99affebeb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841828.836442:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149de00/0xe3dac0c99affebeb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841828.836458:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149de00/0xe3dac0c99affebeb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787841828.836910:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787841828.836915:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787841828.837034:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149de00/0xe3dac0c99affebeb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841828.837081:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affebe4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d69a9 expref: 7 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841828.837103:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149de00/0xe3dac0c99affebeb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d69a9 expref: 6 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841828.837113:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92cbc89cd800) 00010000:00010000:3.0:1787841828.837116:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787841828.837121:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc149de00, rc 0) 00000100:00100000:3.0:1787841828.837211:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf07f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fe7d2185-ae43-428e-8bfa-909f60138853+6:11037:x1874687695060480:12345-192.168.201.1@tcp:101:lsof.0 Request processed in 969us (1323us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841828.837220:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 136 00010000:00010000:3.0:1787841829.442978:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841830.465315:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787841831.168906:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbe99c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3301:1874687714993280:0@lo:400:kworker.0 00000100:00100000:1.0:1787841831.168965:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbe99c4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874687714993792:0@lo:400:kworker.0 00000100:00100000:0.0:1787841831.169008:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841831.169115:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714993280 00000100:00100000:3.0:1787841831.169122:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714993280 00000100:00100000:3.0:1787841831.169171:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1787841831.169180:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:3301:x1874687714993280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841831.169358:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841831.169424:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787841831.169430:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbe99c6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1874687714993920:0@lo:400:kworker.0 00000100:00100000:1.0:1787841831.169461:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841831.169505:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbe99c70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874687714993536:0@lo:400:kworker.0 00000100:00100000:1.0:1787841831.169530:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841831.169549:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e2da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687714994048:0@lo:400:kworker.0 00000100:00100000:1.0:1787841831.169571:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841831.169595:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787841831.169600:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbe99c5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1874687714993664:0@lo:400:kworker.0 00000100:00100000:1.0:1787841831.169622:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841831.169652:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714993792 00000100:00100000:1.0:1787841831.169656:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714993792 00000100:00100000:2.0:1787841831.170018:0:12018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714993920 00000100:00100000:2.0:1787841831.170024:0:12018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714993920 00000100:00100000:2.0:1787841831.170077:0:12018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714993536 00000100:00100000:2.0:1787841831.170081:0:12018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714993536 00000100:00100000:2.0:1787841831.170100:0:12018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714993664 00000100:00100000:2.0:1787841831.170103:0:12018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714993664 00000100:00100000:2.0:1787841831.170119:0:12018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1787841831.170126:0:12018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf8dc9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874687714993920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841831.170177:0:12018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf8dc9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874687714993920:12345-0@lo:400:kworker.0 Request processed in 52us (716us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841831.170184:0:12018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1787841831.170200:0:12018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1787841831.170206:0:12018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf8dc9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874687714993536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841831.170238:0:12018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf8dc9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874687714993536:12345-0@lo:400:kworker.0 Request processed in 32us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841831.170252:0:12018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1787841831.170263:0:12018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1787841831.170270:0:12018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf8dcb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1874687714993664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841831.170301:0:12018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf8dcb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1874687714993664:12345-0@lo:400:kworker.0 Request processed in 32us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841831.170306:0:12018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00080000:2.0:1787841831.170340:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787841831.172424:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbe99c5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1874687714993664:0@lo:400:kworker.0 00000100:00100000:2.0:1787841831.172442:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbe99c70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874687714993536:0@lo:400:kworker.0 00000100:00100000:2.0:1787841831.172486:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbe99c6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1874687714993920:0@lo:400:kworker.0 00000100:00100000:2.0:1787841831.173396:0:9572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714994048 00000100:00100000:2.0:1787841831.173405:0:9572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714994048 00000100:00100000:2.0:1787841831.173471:0:9572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787841831.173481:0:9572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf8dcb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3298:x1874687714994048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841831.174365:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787841831.174375:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cc00ddda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1874687714993792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841831.174474:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cc00ddda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1874687714993792:12345-0@lo:400:kworker.0 Request processed in 100us (5115us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841831.174481:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787841831.174537:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbe99c4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874687714993792:0@lo:400:kworker.0 00000100:00080000:1.0:1787841831.174625:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787841831.174630:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787841831.176953:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf07f8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874687714993408:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787841831.177025:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841831.180179:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714993408 00000100:00100000:1.0:1787841831.180196:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714993408 00000100:00100000:1.0:1787841831.180262:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787841831.180273:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf07f9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1874687714993408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787841831.180318:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787841831.180416:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf07f9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1874687714993408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 145us (3390us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841831.180424:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787841831.182559:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf07f8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874687714993408:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787841831.187569:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:3301:x1874687714993280:12345-0@lo:400:kworker.0 Request processed in 18381us (18552us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841831.187585:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1787841831.187840:0:9572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf8dcb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3298:x1874687714994048:12345-0@lo:400:kworker.0 Request processed in 14358us (18264us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841831.187851:0:9572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787841831.188186:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e2da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687714994048:0@lo:400:kworker.0 00000100:00100000:1.0:1787841831.197975:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbe99c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3301:1874687714993280:0@lo:400:kworker.0 00000020:00080000:1.0:1787841831.301844:0:5860:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:2.0:1787841831.302154:0:5871:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:2.0:1787841831.302168:0:5871:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000001:00080000:1.0:1787841831.302427:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00010000:00010000:3.0:1787841831.491169:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787841832.193234:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf8dcb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874687714994176:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787841832.193326:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841832.193608:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714994176 00000100:00100000:1.0:1787841832.193617:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714994176 00000100:00100000:1.0:1787841832.193695:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787841832.193727:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd7a5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874687714994176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787841832.193775:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787841832.193845:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd7a5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874687714994176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841832.193876:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787841832.194853:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf8dcb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874687714994176:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787841832.513012:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787841833.139688:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841833.139742:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841833.139788:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841833.139805:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841833.139829:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841833.139862:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695060864 00000100:00100000:2.0:1787841833.139873:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695060864 00000100:00100000:2.0:1787841833.139930:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695060992 00000100:00100000:2.0:1787841833.139933:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695060992 00000100:00100000:2.0:1787841833.139956:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 74 00000100:00100000:2.0:1787841833.139965:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd7a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b2767a54-6703-4908-8414-eab6601e2ceb+6:2357:x1874687695060864:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:2.0:1787841833.140041:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd7a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b2767a54-6703-4908-8414-eab6601e2ceb+6:2357:x1874687695060864:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 77us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841833.140049:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 74 00000100:00100000:2.0:1787841833.140069:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 75 00000100:00100000:2.0:1787841833.140076:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe99c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b2767a54-6703-4908-8414-eab6601e2ceb+5:2356:x1874687695060992:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:2.0:1787841833.140098:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe99c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b2767a54-6703-4908-8414-eab6601e2ceb+5:2356:x1874687695060992:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 24us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841833.140103:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 75 00000100:00100000:2.0:1787841833.140118:0:12018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695061120 00000100:00100000:2.0:1787841833.140121:0:12018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695061120 00000100:00100000:2.0:1787841833.140146:0:12018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695060736 00000100:00100000:2.0:1787841833.140148:0:12018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695060736 00000100:00100000:2.0:1787841833.140165:0:12018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 168 00000100:00100000:2.0:1787841833.140170:0:12018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd7a6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fe7d2185-ae43-428e-8bfa-909f60138853+6:2357:x1874687695061120:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:2.0:1787841833.140192:0:12018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd7a6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fe7d2185-ae43-428e-8bfa-909f60138853+6:2357:x1874687695061120:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 22us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841833.140197:0:12018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 168 00000100:00100000:2.0:1787841833.140217:0:12018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 169 00000100:00100000:2.0:1787841833.140223:0:12018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e2da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b2767a54-6703-4908-8414-eab6601e2ceb+13:2356:x1874687695060736:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:2.0:1787841833.140249:0:12018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e2da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b2767a54-6703-4908-8414-eab6601e2ceb+13:2356:x1874687695060736:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 27us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841833.140254:0:12018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 169 00000100:00080000:2.0:1787841833.140275:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787841833.140281:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787841833.140282:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787841833.140648:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695060608 00000100:00100000:3.0:1787841833.140653:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695060608 00000100:00100000:3.0:1787841833.140690:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 304 00000100:00100000:3.0:1787841833.140717:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a1f1ce-26b5-4cc6-a1db-8e09063432da+13:2357:x1874687695060608:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:3.0:1787841833.140758:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a1f1ce-26b5-4cc6-a1db-8e09063432da+13:2357:x1874687695060608:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 63us (1085us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841833.140765:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 304 00010000:00010000:2.0:1787841833.539567:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787841834.006024:0:12262:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 10:43:52 (1787841832) 00010000:00010000:3.0:1787841834.560958:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787841835.418365:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841835.418487:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695061376 00000100:00100000:1.0:1787841835.418497:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695061376 00000100:00100000:1.0:1787841835.418578:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 137 00000100:00100000:1.0:1787841835.418590:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe99c4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+13:11302:x1874687695061376:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787841835.418611:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841835.418634:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9dc00/0xe3dac0c99affebf2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d69b0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841835.418756:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affebf9 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841835.418777:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affebf9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841835.418792:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affebf9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841835.418808:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d200/0xe3dac0c99affec00 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841835.418817:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d200/0xe3dac0c99affec00 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841835.418824:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d200/0xe3dac0c99affec00 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841835.419342:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9ca00/0xe3dac0c99affec07 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841835.419364:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9ca00/0xe3dac0c99affec07 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841835.419372:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9ca00/0xe3dac0c99affec07 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787841835.419383:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1787841835.419633:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affebf9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841835.419642:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affebf9 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841835.419650:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affebf9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841835.419656:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cc00d9d600 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:1.0:1787841835.419661:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affebf9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841835.419670:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affebf9 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841835.419684:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff92cbc57e3500) 00010000:00010000:1.0:1787841835.419687:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787841835.419692:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affebf9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841835.419738:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affebf9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841835.419753:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d200/0xe3dac0c99affec00 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841835.419765:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d200/0xe3dac0c99affec00 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841835.419771:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d200/0xe3dac0c99affec00 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841835.419776:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cc00d9d200 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:1.0:1787841835.419779:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d200/0xe3dac0c99affec00 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841835.419784:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d200/0xe3dac0c99affec00 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841835.419792:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff92cbd1fc7b00) 00010000:00010000:1.0:1787841835.419795:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787841835.419797:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d200/0xe3dac0c99affec00 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841835.419803:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d200/0xe3dac0c99affec00 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841835.420203:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9dc00/0xe3dac0c99affebf2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d69b0 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841835.420218:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9ca00/0xe3dac0c99affec07 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d69b0 expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841835.420226:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff92cbc57e3b00) 00010000:00010000:1.0:1787841835.420229:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787841835.420237:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cc00d9ca00, rc 0) 00000100:00100000:1.0:1787841835.420307:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe99c4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+15:11302:x1874687695061376:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 Request processed in 1719us (1951us total) trans 4294967415 rc 0/0 00000100:00100000:1.0:1787841835.420315:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 137 00000100:00080000:2.0:1787841835.420438:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787841835.426123:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841835.426276:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841835.426488:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695061632 00000100:00100000:0.0:1787841835.426510:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695061632 00000100:00100000:0.0:1787841835.426634:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 9 00000100:00100000:0.0:1787841835.426646:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcdb79850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b2767a54-6703-4908-8414-eab6601e2ceb+15:2355:x1874687695061632:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787841835.426669:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787841835.427095:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9ca00/0xe3dac0c99affec07 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d69b0 expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841835.427127:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff92cbc57e3b00) 00010000:00010000:0.0:1787841835.427134:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787841835.427231:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcdb79850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b2767a54-6703-4908-8414-eab6601e2ceb+14:2355:x1874687695061632:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 587us (953us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841835.427240:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 9 00000100:00100000:2.0:1787841835.430042:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695061504 00000100:00100000:2.0:1787841835.430069:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695061504 00000100:00100000:2.0:1787841835.430162:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 138 00000100:00100000:2.0:1787841835.430176:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd44b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2767a54-6703-4908-8414-eab6601e2ceb+14:11302:x1874687695061504:12345-192.168.201.1@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787841835.430350:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd44b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2767a54-6703-4908-8414-eab6601e2ceb+14:11302:x1874687695061504:12345-192.168.201.1@tcp:59:lhsmtool_posix.0 Request processed in 178us (4242us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841835.430359:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 138 00010000:00010000:2.0:1787841835.595230:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787841836.295303:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787841836.295355:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf07f8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874687714994304:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787841836.297318:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841836.298094:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714994304 00000100:00100000:1.0:1787841836.298119:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714994304 00000100:00100000:1.0:1787841836.298233:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787841836.298249:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe99c6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874687714994304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787841836.298316:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787841836.298445:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe99c6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874687714994304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 201us (1142us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841836.298454:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:1.0:1787841836.300032:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787841836.300077:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbe99c70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3301:1874687714994432:0@lo:400:kworker.0 00000100:00100000:1.0:1787841836.300181:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841836.300300:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf07f8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874687714994304:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787841836.300359:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714994432 00000100:00100000:1.0:1787841836.300381:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714994432 00000100:00100000:1.0:1787841836.300462:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1787841836.300473:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:3301:x1874687714994432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841836.301751:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbc3dcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874687714994816:0@lo:400:kworker.0 00000100:00100000:2.0:1787841836.301861:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841836.302990:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbe99c5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874687714994560:0@lo:400:kworker.0 00000100:00100000:3.0:1787841836.303071:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841836.303138:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787841836.303146:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbc3dcf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1874687714994688:0@lo:400:kworker.0 00000100:00100000:3.0:1787841836.303172:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841836.303219:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714994560 00000100:00100000:3.0:1787841836.303230:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714994560 00000100:00100000:3.0:1787841836.303305:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714994688 00000100:00100000:3.0:1787841836.303310:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714994688 00000100:00100000:3.0:1787841836.303352:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1787841836.303565:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787841836.304920:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd7a0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874687714994560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841836.315678:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbc3dcfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1874687714994944:0@lo:400:kworker.0 00000100:00100000:2.0:1787841836.315875:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841836.315981:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714994816 00000100:00100000:2.0:1787841836.315993:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714994816 00000100:00100000:2.0:1787841836.316071:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787841836.316080:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbc3dce940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1874687714994816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841836.316145:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbc3dce940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1874687714994816:12345-0@lo:400:kworker.0 Request processed in 65us (14283us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841836.316154:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787841836.316229:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbc3dcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874687714994816:0@lo:400:kworker.0 00000100:00100000:1.0:1787841836.316971:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:3301:x1874687714994432:12345-0@lo:400:kworker.0 Request processed in 4209us (4499us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841836.316986:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1787841836.317078:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbe99c70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3301:1874687714994432:0@lo:400:kworker.0 00000100:00100000:1.0:1787841836.317113:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714994944 00000100:00100000:1.0:1787841836.317119:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714994944 00000100:00100000:3.0:1787841836.321732:0:12018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1787841836.321784:0:12018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd7a2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1874687714994688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787841836.322030:0:12018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd7a2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1874687714994688:12345-0@lo:400:kworker.0 Request processed in 269us (18855us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841836.322190:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbc3dcf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1874687714994688:0@lo:400:kworker.0 00000100:00080000:0.0:1787841836.322355:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787841836.322364:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787841836.325033:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1787841836.325067:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff4d4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874687714994944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841836.325243:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff4d4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874687714994944:12345-0@lo:400:kworker.0 Request processed in 192us (9369us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841836.325252:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1787841836.327847:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbc3dcfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1874687714994944:0@lo:400:kworker.0 00000100:00100000:2.0:1787841836.331000:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd7a0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874687714994560:12345-0@lo:400:kworker.0 Request processed in 27619us (27911us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841836.331025:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1787841836.331126:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbe99c5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874687714994560:0@lo:400:kworker.0 00000100:00100000:3.0:1787841836.337151:0:12018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000040:00080000:2.0:1787841836.420345:0:11682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787841836.420361:0:11682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787841836.420994:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1787841836.421010:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:1.0:1787841836.452290:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00010000:00010000:0.0:1787841836.610968:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787841837.318061:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787841837.318106:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff4d6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874687714995072:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787841837.318219:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841837.318812:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714995072 00000100:00100000:2.0:1787841837.318825:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714995072 00000100:00100000:2.0:1787841837.318894:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787841837.318903:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf07f83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874687714995072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787841837.318955:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787841837.319034:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf07f83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874687714995072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 131us (816us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841837.319041:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787841837.319106:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff4d6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874687714995072:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1787841837.441069:0:11682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787841837.441084:0:11682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787841837.442151:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:0.0:1787841837.442163:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787841837.638027:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787841837.814205:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841837.814433:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695061760 00000100:00100000:0.0:1787841837.814447:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695061760 00000100:00100000:0.0:1787841837.814620:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 139 00000100:00100000:0.0:1787841837.814646:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd7a0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+13:11344:x1874687695061760:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:0.0:1787841837.814678:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841837.814732:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3bc00/0xe3dac0c99affec15 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d69b7 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787841837.815378:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787841837.816418:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a000/0xe3dac0c99affec1c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841837.816440:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a000/0xe3dac0c99affec1c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841837.816524:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a000/0xe3dac0c99affec1c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841837.816546:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b400/0xe3dac0c99affec23 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841837.816555:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b400/0xe3dac0c99affec23 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841837.816564:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b400/0xe3dac0c99affec23 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841837.817324:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a000/0xe3dac0c99affec1c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841837.817340:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a000/0xe3dac0c99affec1c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841837.817347:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a000/0xe3dac0c99affec1c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841837.817365:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbffa3a000 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:0.0:1787841837.817370:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a000/0xe3dac0c99affec1c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841837.817388:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a000/0xe3dac0c99affec1c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841837.817405:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92cbc89cd800) 00010000:00010000:0.0:1787841837.817409:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841837.817415:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a000/0xe3dac0c99affec1c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841837.817423:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a000/0xe3dac0c99affec1c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841837.817438:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b400/0xe3dac0c99affec23 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841837.817444:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b400/0xe3dac0c99affec23 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841837.817451:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b400/0xe3dac0c99affec23 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841837.817530:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbffa3b400 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:0.0:1787841837.817534:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b400/0xe3dac0c99affec23 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841837.817543:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b400/0xe3dac0c99affec23 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841837.817564:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff92cbc57e3f00) 00010000:00010000:0.0:1787841837.817568:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841837.817572:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b400/0xe3dac0c99affec23 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841837.817580:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b400/0xe3dac0c99affec23 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841837.817638:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3bc00/0xe3dac0c99affec15 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d69b7 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841837.817651:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92cbc89cd800) 00010000:00010000:0.0:1787841837.817654:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841837.817658:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3bc00/0xe3dac0c99affec15 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d69b7 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841837.817669:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbffa3bc00, rc 0) 00000100:00100000:0.0:1787841837.818733:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd7a0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+13:11344:x1874687695061760:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 4081us (4531us total) trans 0 rc 301/301 00000100:00100000:0.0:1787841837.818755:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 139 00000100:00100000:3.0:1787841837.843246:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841837.843328:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695062016 00000100:00100000:0.0:1787841837.843343:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695062016 00000100:00100000:0.0:1787841837.843437:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 140 00000100:00100000:0.0:1787841837.843450:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd7a1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+13:11344:x1874687695062016:12345-192.168.201.1@tcp:36:lfs.0 00010000:00010000:0.0:1787841837.843543:0:9449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787841837.843584:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169ba00/0xe3dac0c99affe593 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d67f0 expref: 13 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841837.843631:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92cbc89cd800) 00010000:00010000:0.0:1787841837.843638:0:9449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787841837.844022:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3bc00/0xe3dac0c99affec2a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841837.844042:0:9449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149de00/0xe3dac0c99affebeb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d69a9 expref: 5 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841837.844053:0:9449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3bc00/0xe3dac0c99affec2a lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841837.844098:0:9449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149de00/0xe3dac0c99affebeb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d69a9 expref: 5 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841837.844116:0:9449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149de00/0xe3dac0c99affebeb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d69a9 expref: 5 pid: 5838 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841837.844135:0:9449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbcd5ac780 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9449:1874687714995200:192.168.201.1@tcp:104: 00000100:00100000:0.0:1787841837.844267:0:9449:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbd1ff9a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787841837.847930:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841837.848033:0:9449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbcd5ac780 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9449:1874687714995200:192.168.201.1@tcp:104: 00010000:00010000:1.0:1787841837.848081:0:9449:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3bc00/0xe3dac0c99affec2a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841837.848092:0:7633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695062144 00000100:00100000:0.0:1787841837.848104:0:7633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695062144 00010000:00010000:0.0:1787841837.849107:0:7633:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149de00/0xe3dac0c99affebeb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d69a9 expref: 6 pid: 5838 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841837.849170:0:7633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 60 00000100:00100000:0.0:1787841837.849184:0:7633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf90c21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fe7d2185-ae43-428e-8bfa-909f60138853+6:2357:x1874687695062144:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787841837.849205:0:7633:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787841837.849231:0:7633:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149de00/0xe3dac0c99affebeb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d69a9 expref: 6 pid: 5838 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841837.849247:0:7633:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149de00/0xe3dac0c99affebeb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d69a9 expref: 6 pid: 5838 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841837.849279:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149de00/0xe3dac0c99affebeb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d69a9 expref: 6 pid: 5838 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841837.849303:0:7633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92cbc89cd800) 00010000:00010000:0.0:1787841837.849309:0:7633:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3bc00/0xe3dac0c99affec2a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841837.849320:0:7633:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3bc00/0xe3dac0c99affec2a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841837.849329:0:7633:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3bc00/0xe3dac0c99affec2a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841837.849369:0:7633:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787841837.849413:0:9449:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3bc00/0xe3dac0c99affec2a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841837.849425:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3bc00/0xe3dac0c99affec2a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841837.849467:0:7633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf90c21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fe7d2185-ae43-428e-8bfa-909f60138853+5:2357:x1874687695062144:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 286us (1550us total) trans 0 rc 0/0 00010000:00010000:2.0:1787841837.849468:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104200/0xe3dac0c99affec31 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841837.849487:0:7633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 60 00010000:00010000:2.0:1787841837.849488:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104200/0xe3dac0c99affec31 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841837.849500:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104200/0xe3dac0c99affec31 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787841837.854597:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:2.0:1787841837.858674:0:9449:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1787841837.858722:0:9449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3bc00/0xe3dac0c99affec2a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841837.858735:0:9449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3bc00/0xe3dac0c99affec2a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841837.858746:0:9449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3bc00/0xe3dac0c99affec2a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841837.858753:0:9449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbffa3bc00 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:2.0:1787841837.858759:0:9449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3bc00/0xe3dac0c99affec2a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841837.858778:0:9449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3bc00/0xe3dac0c99affec2a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841837.858801:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92cbc89cd800) 00010000:00010000:2.0:1787841837.858805:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787841837.858811:0:9449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3bc00/0xe3dac0c99affec2a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841837.858818:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3bc00/0xe3dac0c99affec2a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787841837.858845:0:9449:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000358d86f0 reply state 000000007846943a transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104200/0xe3dac0c99affec31 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841837.858856:0:9449:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787841837.858996:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd7a1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+14:11344:x1874687695062016:12345-192.168.201.1@tcp:36:lfs.0 Request processed in 15543us (15755us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1787841837.859008:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 140 00010000:00010000:3.0:1787841837.863813:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104200/0xe3dac0c99affec31 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841837.863842:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104200/0xe3dac0c99affec31 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841837.863851:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104200/0xe3dac0c99affec31 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841837.863857:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6104200 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:3.0:1787841837.863863:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104200/0xe3dac0c99affec31 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841837.863871:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104200/0xe3dac0c99affec31 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841837.863892:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff92cbc3b04f00) 00010000:00010000:3.0:1787841837.863895:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787841837.863901:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104200/0xe3dac0c99affec31 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841837.863909:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104200/0xe3dac0c99affec31 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841837.950389:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841837.950581:0:12018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695062272 00000100:00100000:0.0:1787841837.950597:0:12018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695062272 00000100:00100000:0.0:1787841837.950676:0:12018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 141 00000100:00100000:0.0:1787841837.950688:0:12018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf90c0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b2767a54-6703-4908-8414-eab6601e2ceb+13:11352:x1874687695062272:12345-192.168.201.1@tcp:101:lctl.0 00010000:00010000:0.0:1787841837.950760:0:12018:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841837.950839:0:12018:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affec38 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d69be expref: -99 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841837.950933:0:12018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d200/0xe3dac0c99affec3f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841837.950950:0:12018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d200/0xe3dac0c99affec3f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841837.950965:0:12018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d200/0xe3dac0c99affec3f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787841837.951060:0:12018:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787841837.951066:0:12018:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1787841837.951104:0:12018:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d200/0xe3dac0c99affec3f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841837.951148:0:12018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affec38 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d69be expref: 15 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841837.951190:0:12018:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d200/0xe3dac0c99affec3f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d69be expref: 14 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841837.951200:0:12018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92cbd1fc7e00) 00010000:00010000:1.0:1787841837.951203:0:12018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787841837.951208:0:12018:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cc00d9d200, rc 0) 00000100:00100000:1.0:1787841837.951306:0:12018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf90c0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b2767a54-6703-4908-8414-eab6601e2ceb+14:11352:x1874687695062272:12345-192.168.201.1@tcp:101:lctl.0 Request processed in 619us (941us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841837.951315:0:12018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 141 00000100:00100000:3.0:1787841838.047804:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841838.048068:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695062400 00000100:00100000:0.0:1787841838.048092:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695062400 00000100:00100000:0.0:1787841838.048206:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 142 00000100:00100000:0.0:1787841838.048217:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff409a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+14:11358:x1874687695062400:12345-192.168.201.1@tcp:101:bash.0 00010000:00010000:0.0:1787841838.048244:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841838.048268:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3aa00/0xe3dac0c99affec46 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d69c5 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841838.048342:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b600/0xe3dac0c99affec4d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841838.048356:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b600/0xe3dac0c99affec4d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841838.048369:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b600/0xe3dac0c99affec4d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841838.048392:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b000/0xe3dac0c99affec54 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841838.048398:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b000/0xe3dac0c99affec54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841838.048402:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b000/0xe3dac0c99affec54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841838.048795:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3ba00/0xe3dac0c99affec5b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841838.048805:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3ba00/0xe3dac0c99affec5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841838.048812:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3ba00/0xe3dac0c99affec5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787841838.048869:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:0.0:1787841838.048873:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787841838.048904:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3ba00/0xe3dac0c99affec5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841838.048918:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b600/0xe3dac0c99affec4d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841838.048926:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b600/0xe3dac0c99affec4d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841838.048932:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b600/0xe3dac0c99affec4d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841838.048937:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbffa3b600 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:0.0:1787841838.048941:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b600/0xe3dac0c99affec4d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841838.048947:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b600/0xe3dac0c99affec4d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841838.048960:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92cbd1fc7e00) 00010000:00010000:0.0:1787841838.048962:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841838.048966:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b600/0xe3dac0c99affec4d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841838.048971:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b600/0xe3dac0c99affec4d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841838.048982:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b000/0xe3dac0c99affec54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841838.048995:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b000/0xe3dac0c99affec54 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841838.048999:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b000/0xe3dac0c99affec54 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841838.049001:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbffa3b000 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:0.0:1787841838.049003:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b000/0xe3dac0c99affec54 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841838.049006:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b000/0xe3dac0c99affec54 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841838.049010:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff92cbc57e3f00) 00010000:00010000:0.0:1787841838.049012:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841838.049013:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b000/0xe3dac0c99affec54 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841838.049016:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b000/0xe3dac0c99affec54 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841838.049046:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3aa00/0xe3dac0c99affec46 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d69c5 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841838.049056:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3ba00/0xe3dac0c99affec5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d69c5 expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841838.049062:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92cbc57e3e00) 00010000:00010000:0.0:1787841838.049064:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787841838.049070:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbffa3ba00, rc 0) 00000100:00100000:0.0:1787841838.049156:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff409a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+15:11358:x1874687695062400:12345-192.168.201.1@tcp:101:bash.0 Request processed in 940us (1373us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841838.049165:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 142 00000100:00100000:1.0:1787841838.063905:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841838.065141:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695062656 00000100:00100000:2.0:1787841838.065158:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695062656 00000100:00100000:2.0:1787841838.065250:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 143 00000100:00100000:2.0:1787841838.065264:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf8dc9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+15:11358:x1874687695062656:12345-192.168.201.1@tcp:101:bash.0 00010000:00010000:2.0:1787841838.065307:0:9449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841838.065348:0:9449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104800/0xe3dac0c99affec62 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d69cc expref: -99 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841838.065716:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105e00/0xe3dac0c99affec69 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841838.065760:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105e00/0xe3dac0c99affec69 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841838.065773:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105e00/0xe3dac0c99affec69 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841838.069202:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105c00/0xe3dac0c99affec70 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841838.069614:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105c00/0xe3dac0c99affec70 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841838.069627:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105c00/0xe3dac0c99affec70 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787841838.071576:0:9449:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:2.0:1787841838.072027:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105800/0xe3dac0c99affec77 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841838.072046:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105800/0xe3dac0c99affec77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841838.072059:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105800/0xe3dac0c99affec77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841838.072363:0:9449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105e00/0xe3dac0c99affec69 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841838.072373:0:9449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105e00/0xe3dac0c99affec69 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841838.072391:0:9449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105e00/0xe3dac0c99affec69 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841838.072415:0:9449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6105e00 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:2.0:1787841838.072421:0:9449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105e00/0xe3dac0c99affec69 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841838.072429:0:9449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105e00/0xe3dac0c99affec69 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841838.072445:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92cbc57e3e00) 00010000:00010000:2.0:1787841838.072449:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787841838.072456:0:9449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105e00/0xe3dac0c99affec69 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841838.072528:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105e00/0xe3dac0c99affec69 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787841838.072550:0:9449:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004b17425f reply state 000000001efcb617 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105c00/0xe3dac0c99affec70 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841838.072559:0:9449:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787841838.072611:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104800/0xe3dac0c99affec62 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d69cc expref: 18 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841838.072627:0:9449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105800/0xe3dac0c99affec77 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d69cc expref: 17 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841838.072635:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92cbc3b04500) 00010000:00010000:2.0:1787841838.072638:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787841838.072640:0:9449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc6105800, rc 0) 00000100:00100000:2.0:1787841838.072822:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf8dc9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+18:11358:x1874687695062656:12345-192.168.201.1@tcp:101:bash.0 Request processed in 7561us (8933us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1787841838.072841:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 143 00010000:00010000:1.0:1787841838.075184:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105c00/0xe3dac0c99affec70 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841838.075209:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105c00/0xe3dac0c99affec70 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841838.075220:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105c00/0xe3dac0c99affec70 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841838.075228:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6105c00 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:1.0:1787841838.075234:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105c00/0xe3dac0c99affec70 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841838.075244:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105c00/0xe3dac0c99affec70 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841838.075266:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff92cbc3b04800) 00010000:00010000:1.0:1787841838.075270:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787841838.075295:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105c00/0xe3dac0c99affec70 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841838.075304:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105c00/0xe3dac0c99affec70 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841838.082313:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841838.082502:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695062784 00000100:00100000:2.0:1787841838.082515:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695062784 00000100:00100000:2.0:1787841838.082609:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 48 00000100:00100000:2.0:1787841838.082621:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf8dc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b2767a54-6703-4908-8414-eab6601e2ceb+5:2356:x1874687695062784:12345-192.168.201.1@tcp:101:bash.0 00010000:00010000:2.0:1787841838.082646:0:6688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841838.082674:0:6688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000091d01c44/0xe3dac0c99affec85 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d69d3 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787841838.082756:0:6688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787841838.082784:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=378s v=(0 0) 00010000:00010000:2.0:1787841838.082797:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787841838.082809:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091d01c44/0xe3dac0c99affec85 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d69d3 expref: 6 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841838.082833:0:6688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000091d01c44/0xe3dac0c99affec85 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d69d3 expref: 6 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841838.082851:0:6688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc6104800, rc 0) 00000100:00100000:2.0:1787841838.082921:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf8dc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b2767a54-6703-4908-8414-eab6601e2ceb+6:2356:x1874687695062784:12345-192.168.201.1@tcp:101:bash.0 Request processed in 303us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841838.082929:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 48 00000100:00080000:1.0:1787841838.083077:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787841838.085883:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841838.086665:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695062912 00000100:00100000:2.0:1787841838.086679:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695062912 00000100:00100000:2.0:1787841838.086793:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 49 00000100:00100000:2.0:1787841838.086804:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff409680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b2767a54-6703-4908-8414-eab6601e2ceb+6:11358:x1874687695062912:12345-192.168.201.1@tcp:101:bash.0 00010000:00010000:2.0:1787841838.086845:0:6687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841838.086868:0:6687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003bd245da/0xe3dac0c99affec8c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d69da expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841838.086911:0:6687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000091d01c44/0xe3dac0c99affec85 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d69d3 expref: 7 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841838.086922:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787841838.086928:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787841838.086934:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003bd245da/0xe3dac0c99affec8c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d69da expref: 7 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841838.086976:0:6687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000091d01c44/0xe3dac0c99affec85 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d69d3 expref: 7 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841838.086992:0:6687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000091d01c44/0xe3dac0c99affec85 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d69d3 expref: 7 pid: 6688 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841838.087021:0:6687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff4d6940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6687:1874687714995328:192.168.201.1@tcp:104: 00000100:00100000:2.0:1787841838.087146:0:6687:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc6555300 going to sleep for 11 seconds 00000100:00100000:3.0:1787841838.096664:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841838.097614:0:6687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff4d6940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6687:1874687714995328:192.168.201.1@tcp:104: 00010000:00010000:2.0:1787841838.097680:0:6687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003bd245da/0xe3dac0c99affec8c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d69da expref: 7 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841838.097758:0:6687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc6105e00, rc 0) 00000100:00100000:1.0:1787841838.098772:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695063040 00000100:00100000:1.0:1787841838.098791:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695063040 00010000:00010000:1.0:1787841838.098857:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000091d01c44/0xe3dac0c99affec85 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d69d3 expref: 8 pid: 6688 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841838.098915:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 61 00000100:00100000:1.0:1787841838.098927:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff408000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b2767a54-6703-4908-8414-eab6601e2ceb+8:2357:x1874687695063040:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787841838.098954:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787841838.098989:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000091d01c44/0xe3dac0c99affec85 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d69d3 expref: 8 pid: 6688 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841838.099009:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000091d01c44/0xe3dac0c99affec85 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d69d3 expref: 8 pid: 6688 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841838.099043:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091d01c44/0xe3dac0c99affec85 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d69d3 expref: 8 pid: 6688 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841838.099069:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00000100:00100000:2.0:1787841838.099071:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff409680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b2767a54-6703-4908-8414-eab6601e2ceb+7:11358:x1874687695062912:12345-192.168.201.1@tcp:101:bash.0 Request processed in 12266us (13213us total) trans 0 rc 0/0 00010000:00010000:1.0:1787841838.099075:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00000100:00100000:2.0:1787841838.099081:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 49 00010000:00010000:1.0:1787841838.099085:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003bd245da/0xe3dac0c99affec8c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d69da expref: 7 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841838.099129:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003bd245da/0xe3dac0c99affec8c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d69da expref: 6 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841838.099347:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003bd245da/0xe3dac0c99affec8c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d69da expref: 6 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841838.099546:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf8dc8f00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5825:1874687714995456:192.168.201.1@tcp:105: 00000100:00100000:1.0:1787841838.099758:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbcd629840 going to sleep for 11 seconds 00000100:00100000:1.0:1787841838.105557:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf8dc8f00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5825:1874687714995456:192.168.201.1@tcp:105: 00010000:00010000:1.0:1787841838.105600:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787841838.105739:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff408000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b2767a54-6703-4908-8414-eab6601e2ceb+6:2357:x1874687695063040:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 6812us (9087us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841838.105756:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 61 00000100:00100000:3.0:1787841838.108949:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841838.109087:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695063296 00000100:00100000:2.0:1787841838.109102:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695063296 00000100:00100000:2.0:1787841838.109302:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 36 00000100:00100000:2.0:1787841838.109325:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff408f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b2767a54-6703-4908-8414-eab6601e2ceb+17:11358:x1874687695063296:12345-192.168.201.1@tcp:35:bash.0 00000100:00100000:2.0:1787841838.110802:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff408f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b2767a54-6703-4908-8414-eab6601e2ceb+18:11358:x1874687695063296:12345-192.168.201.1@tcp:35:bash.0 Request processed in 1462us (1853us total) trans 4294967418 rc 0/0 00000100:00100000:2.0:1787841838.110821:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 36 00000100:00100000:0.0:1787841838.219505:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841838.219733:0:12018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695063552 00000100:00100000:1.0:1787841838.219750:0:12018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695063552 00000100:00100000:1.0:1787841838.219842:0:12018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 144 00000100:00100000:1.0:1787841838.219854:0:12018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd5ac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b2767a54-6703-4908-8414-eab6601e2ceb+18:11368:x1874687695063552:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:1.0:1787841838.219897:0:12018:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841838.219926:0:12018:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affec93 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d69e1 expref: -99 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787841838.220087:0:12018:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1787841838.220247:0:12018:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affec93 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d69e1 expref: 20 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841838.220286:0:12018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92cbd1fc7e00) 00010000:00010000:1.0:1787841838.220289:0:12018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787841838.220295:0:12018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affec93 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d69e1 expref: 20 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841838.220311:0:12018:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cc00d9d600, rc 0) 00000100:00100000:1.0:1787841838.220411:0:12018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd5ac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b2767a54-6703-4908-8414-eab6601e2ceb+19:11368:x1874687695063552:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 559us (936us total) trans 4294967419 rc 301/301 00000100:00100000:1.0:1787841838.220419:0:12018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 144 00000100:00100000:0.0:1787841838.224822:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841838.224892:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841838.225011:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695063680 00000100:00100000:2.0:1787841838.225024:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695063680 00000100:00100000:2.0:1787841838.225097:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 306 00000100:00100000:2.0:1787841838.225109:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a1f1ce-26b5-4cc6-a1db-8e09063432da+13:2357:x1874687695063680:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:2.0:1787841838.225222:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a1f1ce-26b5-4cc6-a1db-8e09063432da+13:2357:x1874687695063680:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 114us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841838.225232:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 306 00000100:00100000:3.0:1787841838.227184:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695063808 00000100:00100000:3.0:1787841838.227206:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695063808 00000100:00100000:3.0:1787841838.227314:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 77 00000100:00100000:3.0:1787841838.227327:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e66580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b2767a54-6703-4908-8414-eab6601e2ceb+6:2357:x1874687695063808:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:3.0:1787841838.228427:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e66580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b2767a54-6703-4908-8414-eab6601e2ceb+6:2357:x1874687695063808:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 1095us (3526us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841838.228441:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 77 00000100:00080000:2.0:1787841838.228613:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787841838.228805:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841838.229321:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695064064 00000100:00100000:2.0:1787841838.229332:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695064064 00000100:00100000:2.0:1787841838.229407:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 37 00000100:00100000:2.0:1787841838.229417:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf8dc8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b2767a54-6703-4908-8414-eab6601e2ceb+19:11368:x1874687695064064:12345-192.168.201.1@tcp:35:lfs.0 00000100:00100000:2.0:1787841838.229914:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf8dc8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b2767a54-6703-4908-8414-eab6601e2ceb+20:11368:x1874687695064064:12345-192.168.201.1@tcp:35:lfs.0 Request processed in 497us (1108us total) trans 4294967420 rc 0/0 00000100:00100000:2.0:1787841838.229923:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 37 00000100:00100000:1.0:1787841838.354780:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841838.355080:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695064192 00000100:00100000:0.0:1787841838.355096:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695064192 00000100:00100000:0.0:1787841838.355184:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 145 00000100:00100000:0.0:1787841838.355196:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf8dc92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+20:11374:x1874687695064192:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:0.0:1787841838.355232:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841838.355269:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99affeca1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d69e8 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841838.355753:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b600/0xe3dac0c99affeca8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841838.355774:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b600/0xe3dac0c99affeca8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841838.355789:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b600/0xe3dac0c99affeca8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787841838.355971:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:0.0:1787841838.355976:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787841838.356009:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b600/0xe3dac0c99affeca8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841838.356057:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99affeca1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d69e8 expref: 22 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841838.356098:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b600/0xe3dac0c99affeca8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d69e8 expref: 21 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841838.356107:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92cbc57e3e00) 00010000:00010000:0.0:1787841838.356111:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787841838.356115:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbffa3b600, rc 0) 00000100:00100000:0.0:1787841838.356216:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf8dc92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+21:11374:x1874687695064192:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 1022us (1451us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841838.356224:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 145 00000100:00100000:2.0:1787841838.364762:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841838.364916:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695064448 00000100:00100000:0.0:1787841838.364931:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695064448 00000100:00100000:0.0:1787841838.365014:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 146 00000100:00100000:0.0:1787841838.365027:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff4d6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+21:11374:x1874687695064448:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:0.0:1787841838.365057:0:9449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841838.365087:0:9449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99affecaf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d69ef expref: -99 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841838.365420:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b000/0xe3dac0c99affecb6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841838.365438:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b000/0xe3dac0c99affecb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841838.365624:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b000/0xe3dac0c99affecb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787841838.365641:0:9449:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787841838.365861:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99affecaf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d69ef expref: 24 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841838.366235:0:9449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b000/0xe3dac0c99affecb6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d69ef expref: 23 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841838.366245:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92cbc3b04500) 00010000:00010000:0.0:1787841838.366248:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787841838.366253:0:9449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbffa3b000, rc 0) 00000100:00100000:0.0:1787841838.366421:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff4d6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+23:11374:x1874687695064448:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 1396us (1673us total) trans 4294967421 rc 0/0 00000100:00100000:0.0:1787841838.366431:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 146 00000100:00100000:2.0:1787841838.377473:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841838.377685:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695064832 00000100:00100000:0.0:1787841838.377728:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695064832 00000100:00100000:0.0:1787841838.377834:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 10 00000100:00100000:0.0:1787841838.377847:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff4d43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b2767a54-6703-4908-8414-eab6601e2ceb+23:2356:x1874687695064832:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787841838.377879:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787841838.377915:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b000/0xe3dac0c99affecb6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d69ef expref: 23 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841838.377941:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92cbc3b04500) 00010000:00010000:0.0:1787841838.377948:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787841838.378020:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff4d43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b2767a54-6703-4908-8414-eab6601e2ceb+22:2356:x1874687695064832:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 175us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841838.378038:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 10 00000100:00100000:1.0:1787841838.395759:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841838.396006:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695064704 00000100:00100000:3.0:1787841838.396020:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695064704 00000100:00100000:3.0:1787841838.396100:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 147 00000100:00100000:3.0:1787841838.396111:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf8dcb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2767a54-6703-4908-8414-eab6601e2ceb+22:11374:x1874687695064704:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:3.0:1787841838.396144:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841838.396184:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affecc4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d69f6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841838.396435:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affeccb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841838.396467:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affeccb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841838.396481:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affeccb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787841838.396568:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1787841838.396773:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affecc4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d69f6 expref: 25 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841838.396797:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affeccb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d69f6 expref: 24 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841838.396807:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92cbc3b04500) 00010000:00010000:3.0:1787841838.396827:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787841838.396832:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc149d400, rc 0) 00000100:00100000:3.0:1787841838.396916:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf8dcb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2767a54-6703-4908-8414-eab6601e2ceb+24:11374:x1874687695064704:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 806us (1171us total) trans 4294967422 rc 0/0 00000100:00100000:3.0:1787841838.396924:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 147 00000100:00100000:1.0:1787841838.403879:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841838.404128:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695064960 00000100:00100000:2.0:1787841838.404143:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695064960 00000100:00100000:2.0:1787841838.404226:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 50 00000100:00100000:2.0:1787841838.404239:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd44a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b2767a54-6703-4908-8414-eab6601e2ceb+6:2357:x1874687695064960:12345-192.168.201.1@tcp:1:lfs.0 00010000:00010000:2.0:1787841838.404301:0:6686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059d07184/0xe3dac0c99affecd9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841838.404327:0:6686:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003bd245da/0xe3dac0c99affec8c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d69da expref: 6 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841838.404338:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787841838.404344:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787841838.404350:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000059d07184/0xe3dac0c99affecd9 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841838.404721:0:6686:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003bd245da/0xe3dac0c99affec8c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d69da expref: 6 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841838.404740:0:6686:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003bd245da/0xe3dac0c99affec8c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d69da expref: 6 pid: 6687 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841838.404760:0:6686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff4d6d00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6686:1874687714995584:192.168.201.1@tcp:104: 00000100:00100000:2.0:1787841838.404886:0:6686:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc6555300 going to sleep for 11 seconds 00000100:00100000:2.0:1787841838.409187:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841838.409269:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695065088 00000100:00100000:0.0:1787841838.409282:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695065088 00002000:00100000:0.0:1787841838.409397:0:6692:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff92cbff4d7480 x1874687695065088/t0(0) o4->b2767a54-6703-4908-8414-eab6601e2ceb@192.168.201.1@tcp:339/0 lens 504/0 e 0 to 0 dl 1787841849 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787841838.409412:0:6692:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff92cbff4d7480 with x1874687695065088 ext(0->12) 00010000:00010000:0.0:1787841838.409425:0:6692:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003bd245da/0xe3dac0c99affec8c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d69da expref: 7 pid: 6687 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841838.409457:0:6692:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003bd245da/0xe3dac0c99affec8c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d69da expref: 7 pid: 6687 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787841838.409468:0:6692:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92cbff4d7480 00000100:00100000:0.0:1787841838.409741:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 2 00000100:00100000:0.0:1787841838.409756:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff4d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b2767a54-6703-4908-8414-eab6601e2ceb+7:2357:x1874687695065088:12345-192.168.201.1@tcp:4:lfs.0 00000100:00100000:1.0:1787841838.411769:0:6686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff4d6d00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6686:1874687714995584:192.168.201.1@tcp:104: 00000100:00100000:0.0:1787841838.411777:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff4d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b2767a54-6703-4908-8414-eab6601e2ceb+9:2357:x1874687695065088:12345-192.168.201.1@tcp:4:lfs.0 Request processed in 2023us (2606us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1787841838.411789:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 2 00002000:00100000:0.0:1787841838.411803:0:6692:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff92cbff4d7480 x1874687695065088/t4294967305(0) o4->b2767a54-6703-4908-8414-eab6601e2ceb@192.168.201.1@tcp:339/0 lens 504/448 e 0 to 0 dl 1787841849 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1787841838.411810:0:6686:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000059d07184/0xe3dac0c99affecd9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:0.0:1787841838.411813:0:6692:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff92cbff4d7480 with x1874687695065088 ext(0->12) 00010000:00010000:0.0:1787841838.411822:0:6692:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003bd245da/0xe3dac0c99affec8c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d69da expref: 9 pid: 6687 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841838.411836:0:6692:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003bd245da/0xe3dac0c99affec8c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d69da expref: 9 pid: 6687 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787841838.411844:0:6692:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92cbff4d7480 00000100:00100000:1.0:1787841838.421040:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841838.421246:0:7633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695065216 00000100:00100000:0.0:1787841838.421261:0:7633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695065216 00010000:00010000:0.0:1787841838.421328:0:7633:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003bd245da/0xe3dac0c99affec8c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d69da expref: 9 pid: 6687 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841838.421398:0:7633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 62 00000100:00100000:0.0:1787841838.421412:0:7633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe99c5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b2767a54-6703-4908-8414-eab6601e2ceb+9:2356:x1874687695065216:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787841838.421434:0:7633:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787841838.421624:0:7633:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1787841838.421695:0:7633:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787841838 00002000:00010000:0.0:1787841838.421857:0:7633:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787841838 00002000:00010000:0.0:1787841838.421860:0:7633:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1787841838 00010000:00010000:0.0:1787841838.421870:0:7633:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003bd245da/0xe3dac0c99affec8c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d69da expref: 9 pid: 6687 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841838.421891:0:7633:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003bd245da/0xe3dac0c99affec8c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d69da expref: 9 pid: 6687 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841838.421930:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003bd245da/0xe3dac0c99affec8c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d69da expref: 9 pid: 6687 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841838.421960:0:7633:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787841838.421966:0:7633:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787841838.421975:0:7633:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000059d07184/0xe3dac0c99affecd9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841838.421990:0:7633:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000059d07184/0xe3dac0c99affecd9 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841838.422188:0:7633:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787841838.422276:0:7633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe99c5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b2767a54-6703-4908-8414-eab6601e2ceb+8:2356:x1874687695065216:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 866us (1254us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841838.422287:0:7633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 62 00010000:00010000:1.0:1787841838.427824:0:6686:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000059d07184/0xe3dac0c99affecd9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841838.427853:0:6686:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000059d07184/0xe3dac0c99affecd9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841838.428032:0:6686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059d07184/0xe3dac0c99affecd9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841838.428073:0:6686:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000059d07184/0xe3dac0c99affecd9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841838.428083:0:6686:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000059d07184/0xe3dac0c99affecd9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841838.428092:0:6686:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6105200 already unused, calling callback (ffffffffc17a4500) 00010000:00010000:2.0:1787841838.428098:0:6686:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000059d07184/0xe3dac0c99affecd9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841838.428109:0:6686:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000059d07184/0xe3dac0c99affecd9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841838.428135:0:6686:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000059d07184/0xe3dac0c99affecd9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841838.428144:0:6686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000059d07184/0xe3dac0c99affecd9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841838.428587:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd44a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b2767a54-6703-4908-8414-eab6601e2ceb+7:2357:x1874687695064960:12345-192.168.201.1@tcp:1:lfs.0 Request processed in 24342us (24718us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841838.428600:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 50 00000100:00100000:1.0:1787841838.436098:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841838.436297:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695065472 00000100:00100000:2.0:1787841838.436312:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695065472 00000100:00100000:0.0:1787841838.436844:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 38 00000100:00100000:0.0:1787841838.436860:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbc6c33050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b2767a54-6703-4908-8414-eab6601e2ceb+24:11374:x1874687695065472:12345-192.168.201.1@tcp:35:lfs.0 00000100:00100000:2.0:1787841838.436967:0:5841:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:2.0:1787841838.436990:0:5841:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000004:00010000:0.0:1787841838.437417:0:5840:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affeccb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d69f6 expref: 24 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787841838.437809:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:0.0:1787841838.437859:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:0.0:1787841838.443960:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:0.0:1787841838.444108:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99affece0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841838.444139:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105800/0xe3dac0c99affec77 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d69cc expref: 28 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841838.444305:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99affece0 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841838.450081:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105800/0xe3dac0c99affec77 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d69cc expref: 28 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841838.450118:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105800/0xe3dac0c99affec77 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d69cc expref: 28 pid: 9449 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841838.450242:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e2d2c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5840:1874687714995712:192.168.201.1@tcp:104: 00000100:00100000:0.0:1787841838.450801:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbd1ff9b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787841838.456987:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841838.457023:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695065600 00000100:00100000:0.0:1787841838.457035:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695065600 00010000:00010000:0.0:1787841838.457093:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105800/0xe3dac0c99affec77 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d69cc expref: 29 pid: 9449 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841838.457133:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 63 00000100:00100000:0.0:1787841838.457143:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e2e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b2767a54-6703-4908-8414-eab6601e2ceb+29:2356:x1874687695065600:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787841838.457174:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787841838.457184:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105800/0xe3dac0c99affec77 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d69cc expref: 29 pid: 9449 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841838.457199:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105800/0xe3dac0c99affec77 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d69cc expref: 29 pid: 9449 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841838.457232:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92cbc3b04500) 00010000:00010000:0.0:1787841838.457238:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99affece0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841838.457251:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99affece0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841838.457259:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99affece0 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841838.457313:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787841838.458291:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105800/0xe3dac0c99affec77 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d69cc expref: 29 pid: 9449 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841838.458315:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e2d2c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5840:1874687714995712:192.168.201.1@tcp:104: 00010000:00010000:3.0:1787841838.458347:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99affece0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841838.458432:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99affece0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841838.458441:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99affece0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787841838.458759:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:3.0:1787841838.459020:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:3.0:1787841838.459169:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff40a580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5840:1874687714995840:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787841838.459250:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841838.459296:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbd1fe7300 going to sleep for 11 seconds 00000100:00100000:0.0:1787841838.459668:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e2e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b2767a54-6703-4908-8414-eab6601e2ceb+30:2356:x1874687695065600:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 2521us (2688us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841838.459683:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 63 00000100:00100000:1.0:1787841838.460070:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714995840 00000100:00100000:1.0:1787841838.460080:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714995840 00000100:00100000:1.0:1787841838.460162:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787841838.460173:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff40b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5840:x1874687714995840:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787841838.460287:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff40b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5840:x1874687714995840:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 117us (1036us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841838.460294:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787841838.463774:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff40a580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5840:1874687714995840:0@lo:1000:mdt_rdpg00_000.0 00000100:00080000:2.0:1787841838.464661:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1787841838.466760:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:3.0:1787841838.466926:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff40a580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5840:1874687714995968:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787841838.467036:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841838.467139:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbd1fe7600 going to sleep for 11 seconds 00000100:00100000:1.0:1787841838.470265:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714995968 00000100:00100000:1.0:1787841838.470292:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714995968 00000100:00100000:1.0:1787841838.470643:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787841838.470659:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6c6a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5840:x1874687714995968:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787841838.471093:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6c6a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5840:x1874687714995968:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 438us (4056us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1787841838.471101:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787841838.471245:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff40a580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5840:1874687714995968:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787841838.471382:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:3.0:1787841838.471461:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99affece0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841838.471475:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99affece0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841838.471484:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99affece0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841838.471491:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbffa3be00 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:3.0:1787841838.471496:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99affece0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841838.471505:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99affece0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841838.471525:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92cbc3b04500) 00010000:00010000:3.0:1787841838.471528:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787841838.471534:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99affece0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841838.471540:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99affece0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787841838.471848:0:5840:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787841838.471988:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:3.0:1787841838.472007:0:5840:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 378470308314ns, next at 379470304103ns, rc = 0 00000001:00080000:3.0:1787841838.472014:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:3.0:1787841838.472056:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92cbc3b04500) 00010000:00010000:3.0:1787841838.472077:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787841838.472086:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affeccb lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d69f6 expref: 32 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841838.472220:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbc6c33050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b2767a54-6703-4908-8414-eab6601e2ceb+31:11374:x1874687695065472:12345-192.168.201.1@tcp:35:lfs.0 Request processed in 35364us (36136us total) trans 4294967431 rc 0/0 00000100:00100000:3.0:1787841838.472230:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 38 00000020:00080000:3.0:1787841838.472234:0:5840:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1787841838.477502:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841838.477747:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695065728 00000100:00100000:1.0:1787841838.477765:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695065728 00000100:00100000:1.0:1787841838.477849:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 148 00000100:00100000:1.0:1787841838.477862:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e2de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+31:11374:x1874687695065728:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:1.0:1787841838.477903:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841838.477938:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c400/0xe3dac0c99affece7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d69fd expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841838.478036:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c400/0xe3dac0c99affece7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d69fd expref: 32 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841838.478054:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c400/0xe3dac0c99affece7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d69fd expref: 32 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841838.478112:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92cbd1fc7c00) 00010000:00010000:1.0:1787841838.478116:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787841838.478122:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cc00d9c400, rc 0) 00000100:00100000:1.0:1787841838.478224:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e2de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+32:11374:x1874687695065728:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 365us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841838.478233:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 148 00000100:00100000:3.0:1787841838.483353:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841838.483630:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695065984 00000100:00100000:0.0:1787841838.483645:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695065984 00000100:00100000:0.0:1787841838.483776:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 39 00000100:00100000:0.0:1787841838.483788:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6c69a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b2767a54-6703-4908-8414-eab6601e2ceb+32:11374:x1874687695065984:12345-192.168.201.1@tcp:35:lfs.0 00000100:00100000:0.0:1787841838.484639:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6c69a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b2767a54-6703-4908-8414-eab6601e2ceb+33:11374:x1874687695065984:12345-192.168.201.1@tcp:35:lfs.0 Request processed in 848us (1296us total) trans 4294967432 rc 0/0 00000100:00100000:0.0:1787841838.484649:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 39 00000100:00100000:2.0:1787841838.633273:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841838.633393:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695066240 00000100:00100000:0.0:1787841838.633406:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695066240 00000100:00100000:0.0:1787841838.633500:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 149 00000100:00100000:0.0:1787841838.633513:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff4d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+33:11384:x1874687695066240:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:0.0:1787841838.633556:0:9449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841838.633585:0:9449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3aa00/0xe3dac0c99affecee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6a04 expref: -99 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787841838.633768:0:9449:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1787841838.633933:0:9449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3aa00/0xe3dac0c99affecee lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a04 expref: 35 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841838.633949:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92cbd1fc7e00) 00010000:00010000:0.0:1787841838.633952:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787841838.633978:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3aa00/0xe3dac0c99affecee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a04 expref: 35 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841838.633997:0:9449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbffa3aa00, rc 0) 00000100:00100000:0.0:1787841838.634098:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff4d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+34:11384:x1874687695066240:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 587us (841us total) trans 4294967433 rc 301/301 00000100:00100000:0.0:1787841838.634106:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 149 00000100:00100000:2.0:1787841838.640522:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841838.644987:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695066368 00000100:00100000:1.0:1787841838.645013:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695066368 00000100:00100000:1.0:1787841838.645118:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 150 00000100:00100000:1.0:1787841838.645131:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff4d6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+34:11384:x1874687695066368:12345-192.168.201.1@tcp:34:lfs.0 00010000:00010000:1.0:1787841838.645572:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c800/0xe3dac0c99affecfc lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841838.645595:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c800/0xe3dac0c99affecfc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841838.645610:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c800/0xe3dac0c99affecfc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841838.645630:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affed03 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841838.645638:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affed03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841838.645645:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affed03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841838.645980:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9da00/0xe3dac0c99affed0a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841838.646011:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9da00/0xe3dac0c99affed0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841838.646019:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9da00/0xe3dac0c99affed0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787841838.646076:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9da00/0xe3dac0c99affed0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841838.646093:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c800/0xe3dac0c99affecfc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841838.646101:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c800/0xe3dac0c99affecfc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841838.646108:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c800/0xe3dac0c99affecfc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841838.646114:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cc00d9c800 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:1.0:1787841838.646119:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c800/0xe3dac0c99affecfc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841838.646127:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c800/0xe3dac0c99affecfc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841838.646140:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92cbc57e3e00) 00010000:00010000:1.0:1787841838.648005:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787841838.648033:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c800/0xe3dac0c99affecfc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841838.648047:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c800/0xe3dac0c99affecfc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841838.648111:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affed03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841838.648119:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affed03 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841838.648126:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affed03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841838.648133:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cc00d9de00 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:1.0:1787841838.648137:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affed03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841838.648157:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affed03 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841838.648175:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff92cbd1fc7d00) 00010000:00010000:1.0:1787841838.648178:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787841838.648182:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affed03 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841838.648189:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affed03 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841838.648212:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9da00/0xe3dac0c99affed0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841838.648218:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9da00/0xe3dac0c99affed0a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841838.648225:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9da00/0xe3dac0c99affed0a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841838.648237:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cc00d9da00 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:1.0:1787841838.648241:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9da00/0xe3dac0c99affed0a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841838.648247:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9da00/0xe3dac0c99affed0a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841838.648256:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92cbd1fc7c00) 00010000:00010000:1.0:1787841838.648258:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787841838.648261:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9da00/0xe3dac0c99affed0a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841838.648266:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9da00/0xe3dac0c99affed0a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841838.648429:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff4d6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+34:11384:x1874687695066368:12345-192.168.201.1@tcp:34:lfs.0 Request processed in 3293us (7917us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841838.648579:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 150 00000100:00100000:1.0:1787841838.654415:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841838.654556:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695066624 00000100:00100000:3.0:1787841838.654570:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695066624 00000100:00100000:3.0:1787841838.654645:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 40 00000100:00100000:3.0:1787841838.654656:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe99c70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b2767a54-6703-4908-8414-eab6601e2ceb+34:11384:x1874687695066624:12345-192.168.201.1@tcp:35:lfs.0 00000100:00100000:3.0:1787841838.655058:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe99c70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b2767a54-6703-4908-8414-eab6601e2ceb+35:11384:x1874687695066624:12345-192.168.201.1@tcp:35:lfs.0 Request processed in 402us (655us total) trans 4294967434 rc 0/0 00000100:00100000:3.0:1787841838.655068:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 40 00010000:00010000:0.0:1787841838.656888:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787841838.693784:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841838.694130:0:12018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695066880 00000100:00100000:3.0:1787841838.694145:0:12018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695066880 00000100:00100000:3.0:1787841838.694229:0:12018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 151 00000100:00100000:3.0:1787841838.694241:0:12018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf07f8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b2767a54-6703-4908-8414-eab6601e2ceb+35:11387:x1874687695066880:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:3.0:1787841838.694278:0:12018:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841838.694305:0:12018:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affed11 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6a0b expref: -99 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841838.694451:0:12018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affed18 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841838.694470:0:12018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affed18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841838.694503:0:12018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affed18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841838.694521:0:12018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affed1f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841838.694528:0:12018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affed1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841838.694535:0:12018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affed1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841838.694744:0:12018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affed26 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841838.694754:0:12018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affed26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841838.694761:0:12018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affed26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787841838.694773:0:12018:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1787841838.694909:0:12018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affed18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841838.694917:0:12018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affed18 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841838.694924:0:12018:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affed18 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841838.694931:0:12018:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc149c400 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:3.0:1787841838.694944:0:12018:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affed18 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841838.694953:0:12018:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affed18 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841838.694970:0:12018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92cbc57e3e00) 00010000:00010000:3.0:1787841838.694974:0:12018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787841838.694980:0:12018:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affed18 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841838.694988:0:12018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affed18 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841838.695007:0:12018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affed1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841838.695015:0:12018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affed1f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841838.695021:0:12018:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affed1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841838.695027:0:12018:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc149c000 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:3.0:1787841838.695030:0:12018:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affed1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841838.695037:0:12018:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affed1f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841838.695045:0:12018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff92cbc89cde00) 00010000:00010000:3.0:1787841838.695047:0:12018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787841838.695056:0:12018:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affed1f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841838.695063:0:12018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affed1f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841838.695121:0:12018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affed11 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a0b expref: 38 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841838.695140:0:12018:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affed26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a0b expref: 37 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841838.695149:0:12018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92cbd1fc7c00) 00010000:00010000:3.0:1787841838.695151:0:12018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787841838.695154:0:12018:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc149d600, rc 0) 00000100:00100000:3.0:1787841838.695251:0:12018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf07f8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b2767a54-6703-4908-8414-eab6601e2ceb+37:11387:x1874687695066880:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 1011us (1483us total) trans 4294967435 rc 0/0 00000100:00100000:3.0:1787841838.695260:0:12018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 151 00000100:00100000:2.0:1787841838.701604:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841838.701832:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695067008 00000100:00100000:3.0:1787841838.701845:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695067008 00000100:00100000:3.0:1787841838.701921:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 152 00000100:00100000:3.0:1787841838.701932:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbc3dcfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2767a54-6703-4908-8414-eab6601e2ceb+37:11387:x1874687695067008:12345-192.168.201.1@tcp:54:lfs.0 00010000:00010000:3.0:1787841838.702034:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affed34 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841838.702056:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affed34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841838.702072:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affed34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841838.702129:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affed34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841838.702137:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affed34 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841838.702145:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affed34 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841838.702152:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc149d400 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:3.0:1787841838.702157:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affed34 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841838.702165:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affed34 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841838.702180:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92cbd1fc7c00) 00010000:00010000:3.0:1787841838.702183:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787841838.702189:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affed34 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841838.702196:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affed34 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841838.702290:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbc3dcfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2767a54-6703-4908-8414-eab6601e2ceb+37:11387:x1874687695067008:12345-192.168.201.1@tcp:54:lfs.0 Request processed in 359us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841838.702299:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 152 00000100:00100000:1.0:1787841838.709097:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841838.709624:0:12373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695067264 00000100:00100000:3.0:1787841838.709639:0:12373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695067264 00000100:00100000:3.0:1787841838.709836:0:12373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 41 00000100:00100000:3.0:1787841838.709867:0:12373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd7a4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b2767a54-6703-4908-8414-eab6601e2ceb+37:11387:x1874687695067264:12345-192.168.201.1@tcp:35:lfs.0 00000100:00100000:3.0:1787841838.710200:0:12373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd7a4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b2767a54-6703-4908-8414-eab6601e2ceb+38:11387:x1874687695067264:12345-192.168.201.1@tcp:35:lfs.0 Request processed in 337us (1120us total) trans 4294967436 rc 0/0 00000100:00100000:3.0:1787841838.710209:0:12373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 41 00000100:00100000:2.0:1787841838.986433:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841838.986503:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695067520 00000100:00100000:1.0:1787841838.986516:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695067520 00000100:00100000:1.0:1787841838.986617:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 153 00000100:00100000:1.0:1787841838.986629:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbc3dcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+38:11419:x1874687695067520:12345-192.168.201.1@tcp:101:cat.0 00010000:00010000:1.0:1787841838.986662:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841838.986694:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affed3b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6a12 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841838.986892:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c800/0xe3dac0c99affed42 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841838.986910:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c800/0xe3dac0c99affed42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841838.986924:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c800/0xe3dac0c99affed42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787841838.986938:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787841838.987094:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affed3b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a12 expref: 41 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841838.987121:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c800/0xe3dac0c99affed42 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a12 expref: 40 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841838.987127:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92cbd1fc7c00) 00010000:00010000:1.0:1787841838.987130:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787841838.987133:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cc00d9c800, rc 0) 00000100:00100000:1.0:1787841838.987220:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbc3dcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+40:11419:x1874687695067520:12345-192.168.201.1@tcp:101:cat.0 Request processed in 593us (805us total) trans 4294967437 rc 0/0 00000100:00100000:1.0:1787841838.987225:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 153 00000100:00100000:2.0:1787841838.991293:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841838.991385:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841838.991517:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695067904 00000100:00100000:3.0:1787841838.991531:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695067904 00000100:00100000:3.0:1787841838.991629:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 11 00000100:00100000:3.0:1787841838.991641:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbd4bb03c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b2767a54-6703-4908-8414-eab6601e2ceb+40:2354:x1874687695067904:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787841838.991662:0:7632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787841838.991746:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c800/0xe3dac0c99affed42 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a12 expref: 40 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841838.991772:0:7632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92cbd1fc7c00) 00010000:00010000:3.0:1787841838.991779:0:7632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787841838.991856:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbd4bb03c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b2767a54-6703-4908-8414-eab6601e2ceb+39:2354:x1874687695067904:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 216us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841838.991865:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 11 00000100:00100000:0.0:1787841838.992084:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695067776 00000100:00100000:0.0:1787841838.992100:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695067776 00000100:00100000:0.0:1787841838.992144:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 42 00000100:00100000:0.0:1787841838.992153:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbc3dcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b2767a54-6703-4908-8414-eab6601e2ceb+39:11419:x1874687695067776:12345-192.168.201.1@tcp:35:cat.0 00000100:00100000:0.0:1787841838.992551:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbc3dcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b2767a54-6703-4908-8414-eab6601e2ceb+40:11419:x1874687695067776:12345-192.168.201.1@tcp:35:cat.0 Request processed in 398us (1277us total) trans 4294967438 rc 0/0 00000100:00100000:0.0:1787841838.992559:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 42 00000100:00100000:2.0:1787841839.026252:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841839.026336:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695068160 00000100:00100000:0.0:1787841839.026354:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695068160 00000100:00100000:0.0:1787841839.026543:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 154 00000100:00100000:0.0:1787841839.026556:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbd4bb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+40:11425:x1874687695068160:12345-192.168.201.1@tcp:101:dd.0 00010000:00010000:0.0:1787841839.026590:0:9449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841839.026594:0:9449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00000100:00080000:2.0:1787841839.026629:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787841839.026634:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b600/0xe3dac0c99affeca8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d69e8 expref: 40 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841839.026661:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92cbc57e3e00) 00010000:00010000:0.0:1787841839.026672:0:9449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787841839.026690:0:9449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3aa00/0xe3dac0c99affed50 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6a19 expref: -99 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841839.026914:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3bc00/0xe3dac0c99affed57 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841839.026929:0:9449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affed26 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a0b expref: 40 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841839.026938:0:9449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3bc00/0xe3dac0c99affed57 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841839.026995:0:9449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affed26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a0b expref: 40 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841839.027011:0:9449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affed26 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a0b expref: 40 pid: 12018 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841839.027027:0:9449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e2d2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9449:1874687714996096:192.168.201.1@tcp:104: 00000100:00100000:0.0:1787841839.027165:0:9449:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbd1ff93c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787841839.037127:0:9449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e2d2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9449:1874687714996096:192.168.201.1@tcp:104: 00010000:00010000:0.0:1787841839.037192:0:9449:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3bc00/0xe3dac0c99affed57 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841839.037628:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841839.037795:0:7633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695068288 00000100:00100000:0.0:1787841839.037804:0:7633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695068288 00010000:00010000:0.0:1787841839.037857:0:7633:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affed26 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a0b expref: 41 pid: 12018 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841839.037911:0:7633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 64 00000100:00100000:0.0:1787841839.037939:0:7633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcdb78850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b2767a54-6703-4908-8414-eab6601e2ceb+41:2357:x1874687695068288:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787841839.037960:0:7633:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787841839.037968:0:7633:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affed26 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a0b expref: 41 pid: 12018 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841839.037983:0:7633:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affed26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a0b expref: 41 pid: 12018 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841839.038013:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affed26 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a0b expref: 41 pid: 12018 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841839.038034:0:7633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92cbd1fc7c00) 00010000:00010000:0.0:1787841839.038039:0:7633:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3bc00/0xe3dac0c99affed57 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841839.038052:0:7633:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3bc00/0xe3dac0c99affed57 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841839.038062:0:7633:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3bc00/0xe3dac0c99affed57 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841839.038127:0:7633:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787841839.038208:0:7633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcdb78850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b2767a54-6703-4908-8414-eab6601e2ceb+40:2357:x1874687695068288:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 270us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841839.038217:0:7633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 64 00010000:00010000:2.0:1787841839.045405:0:9449:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3bc00/0xe3dac0c99affed57 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841839.045430:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3bc00/0xe3dac0c99affed57 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787841839.045476:0:9449:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787841839.045751:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3aa00/0xe3dac0c99affed50 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a19 expref: 41 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841839.045779:0:9449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3bc00/0xe3dac0c99affed57 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a19 expref: 40 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841839.045789:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92cbd1fc7c00) 00010000:00010000:2.0:1787841839.045793:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787841839.045797:0:9449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbffa3bc00, rc 0) 00000100:00100000:2.0:1787841839.045895:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbd4bb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+40:11425:x1874687695068160:12345-192.168.201.1@tcp:101:dd.0 Request processed in 19342us (19808us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1787841839.045930:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 154 00000100:00100000:2.0:1787841839.051054:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841839.051404:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695068544 00000100:00100000:0.0:1787841839.051418:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695068544 00000100:00100000:0.0:1787841839.051514:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 155 00000100:00100000:0.0:1787841839.051527:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbd4bb0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+40:11425:x1874687695068544:12345-192.168.201.1@tcp:36:dd.0 00010000:00010000:0.0:1787841839.051948:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b600/0xe3dac0c99affed65 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841839.051972:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b600/0xe3dac0c99affed65 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841839.051986:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b600/0xe3dac0c99affed65 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787841839.052047:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:0.0:1787841839.052076:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009eac637b reply state 000000008120ee9a transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b600/0xe3dac0c99affed65 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841839.052086:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787841839.052231:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbd4bb0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+43:11425:x1874687695068544:12345-192.168.201.1@tcp:36:dd.0 Request processed in 704us (1191us total) trans 4294967441 rc 0/0 00000100:00100000:0.0:1787841839.052241:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 155 00000020:00080000:0.0:1787841839.052249:0:5837:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787841839.059886:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b600/0xe3dac0c99affed65 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841839.059909:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b600/0xe3dac0c99affed65 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841839.059918:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b600/0xe3dac0c99affed65 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841839.059924:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbffa3b600 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:0.0:1787841839.059930:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b600/0xe3dac0c99affed65 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841839.059940:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b600/0xe3dac0c99affed65 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841839.059999:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92cbd1fc7c00) 00010000:00010000:0.0:1787841839.060003:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841839.060010:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b600/0xe3dac0c99affed65 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841839.060016:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b600/0xe3dac0c99affed65 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841839.535075:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841839.543556:0:12018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695068672 00000100:00100000:3.0:1787841839.543581:0:12018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695068672 00000100:00100000:3.0:1787841839.543848:0:12018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 156 00000100:00100000:3.0:1787841839.543861:0:12018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbd4bb1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b2767a54-6703-4908-8414-eab6601e2ceb+42:11439:x1874687695068672:12345-192.168.201.1@tcp:101:stat.0 00010000:00010000:3.0:1787841839.543896:0:12018:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841839.543925:0:12018:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affed6c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6a20 expref: -99 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841839.544019:0:12018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affed73 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841839.544057:0:12018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affed73 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841839.544072:0:12018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affed73 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841839.544091:0:12018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affed7a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841839.544098:0:12018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affed7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841839.544105:0:12018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affed7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841839.544236:0:12018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affed81 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841839.544264:0:12018:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3bc00/0xe3dac0c99affed57 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a19 expref: 43 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841839.544273:0:12018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affed81 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841839.544320:0:12018:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3bc00/0xe3dac0c99affed57 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a19 expref: 43 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841839.544338:0:12018:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3bc00/0xe3dac0c99affed57 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a19 expref: 43 pid: 9449 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841839.544380:0:12018:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6c6b0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12018:1874687714996224:192.168.201.1@tcp:104: 00000100:00100000:3.0:1787841839.544510:0:12018:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc3022f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787841839.554802:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841839.555664:0:12373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695068928 00000100:00100000:0.0:1787841839.555679:0:12373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695068928 00000100:00100000:0.0:1787841839.555808:0:12373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 43 00000100:00100000:0.0:1787841839.555821:0:12373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6c6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b2767a54-6703-4908-8414-eab6601e2ceb+44:5605:x1874687695068928:12345-192.168.201.1@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787841839.557336:0:12373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6c6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b2767a54-6703-4908-8414-eab6601e2ceb+45:5605:x1874687695068928:12345-192.168.201.1@tcp:35:ldlm_bl.0 Request processed in 1505us (2536us total) trans 4294967442 rc 0/0 00000100:00100000:0.0:1787841839.557350:0:12373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 43 00000100:00100000:1.0:1787841839.561486:0:12018:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6c6b0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12018:1874687714996224:192.168.201.1@tcp:104: 00010000:00010000:1.0:1787841839.561538:0:12018:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affed81 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841839.564114:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841839.564690:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695069056 00000100:00100000:2.0:1787841839.564888:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695069056 00010000:00010000:2.0:1787841839.564960:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3bc00/0xe3dac0c99affed57 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a19 expref: 45 pid: 9449 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841839.565363:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 65 00000100:00100000:2.0:1787841839.565378:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e2e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b2767a54-6703-4908-8414-eab6601e2ceb+45:2357:x1874687695069056:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787841839.565404:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787841839.565413:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3bc00/0xe3dac0c99affed57 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a19 expref: 45 pid: 9449 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841839.565429:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3bc00/0xe3dac0c99affed57 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a19 expref: 45 pid: 9449 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841839.565477:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3bc00/0xe3dac0c99affed57 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a19 expref: 45 pid: 9449 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841839.565499:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92cbd1fc7c00) 00010000:00010000:2.0:1787841839.565505:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affed81 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841839.565516:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affed81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841839.565526:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affed81 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841839.565588:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787841839.565684:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e2e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b2767a54-6703-4908-8414-eab6601e2ceb+44:2357:x1874687695069056:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 310us (1584us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841839.565690:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 65 00010000:00010000:1.0:1787841839.569910:0:12018:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affed81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.569970:0:12018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affed81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787841839.570045:0:12018:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1787841839.570061:0:12018:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787841839.570105:0:12018:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affed81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.570126:0:12018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affed81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.570147:0:12018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affed73 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.570154:0:12018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affed73 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.570162:0:12018:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affed73 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.570169:0:12018:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc149d400 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:1.0:1787841839.570174:0:12018:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affed73 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.570184:0:12018:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affed73 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.570201:0:12018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92cbc57e3e00) 00010000:00010000:1.0:1787841839.570205:0:12018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787841839.570210:0:12018:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affed73 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.570227:0:12018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affed73 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.570250:0:12018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affed7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.570257:0:12018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affed7a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.570264:0:12018:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affed7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.570269:0:12018:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc149c400 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:1.0:1787841839.570272:0:12018:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affed7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.570279:0:12018:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affed7a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.570289:0:12018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff92cbc89cde00) 00010000:00010000:1.0:1787841839.570291:0:12018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787841839.570295:0:12018:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affed7a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.570301:0:12018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affed7a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.570374:0:12018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affed6c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a20 expref: 44 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.570404:0:12018:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affed81 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a20 expref: 43 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.570412:0:12018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92cbd1fc7c00) 00010000:00010000:1.0:1787841839.570415:0:12018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787841839.570418:0:12018:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc149d600, rc 0) 00000100:00100000:1.0:1787841839.571681:0:12018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbd4bb1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b2767a54-6703-4908-8414-eab6601e2ceb+43:11439:x1874687695068672:12345-192.168.201.1@tcp:101:stat.0 Request processed in 27570us (36369us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841839.571820:0:12018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 156 00000100:00100000:0.0:1787841839.624590:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841839.624883:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695069312 00000100:00100000:2.0:1787841839.624897:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695069312 00000100:00100000:2.0:1787841839.624988:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 157 00000100:00100000:2.0:1787841839.625001:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e2d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+43:11445:x1874687695069312:12345-192.168.201.1@tcp:36:truncate.0 00010000:00010000:2.0:1787841839.625089:0:9449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787841839.625293:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affed81 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a20 expref: 43 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841839.625379:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92cbd1fc7c00) 00010000:00010000:2.0:1787841839.625388:0:9449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787841839.628472:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104a00/0xe3dac0c99affed88 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841839.628503:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104a00/0xe3dac0c99affed88 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841839.628518:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104a00/0xe3dac0c99affed88 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787841839.628680:0:9449:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:2.0:1787841839.630262:0:9449:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001ff419ee reply state 00000000c656cd46 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104a00/0xe3dac0c99affed88 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841839.630284:0:9449:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787841839.630810:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e2d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+45:11445:x1874687695069312:12345-192.168.201.1@tcp:36:truncate.0 Request processed in 5805us (6231us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1787841839.630820:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 157 00000020:00080000:2.0:1787841839.630829:0:9449:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787841839.634556:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104a00/0xe3dac0c99affed88 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.634577:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104a00/0xe3dac0c99affed88 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.634583:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104a00/0xe3dac0c99affed88 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.634587:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6104a00 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:1.0:1787841839.634592:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104a00/0xe3dac0c99affed88 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.634598:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104a00/0xe3dac0c99affed88 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.634620:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92cbd1fc7c00) 00010000:00010000:1.0:1787841839.634623:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787841839.634629:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104a00/0xe3dac0c99affed88 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.634654:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104a00/0xe3dac0c99affed88 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841839.681021:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787841839.747845:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841839.747957:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695069440 00000100:00100000:1.0:1787841839.747969:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695069440 00000100:00100000:1.0:1787841839.748036:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 158 00000100:00100000:1.0:1787841839.748046:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf90c21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+44:11459:x1874687695069440:12345-192.168.201.1@tcp:101:stat.0 00010000:00010000:1.0:1787841839.748082:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841839.748105:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affed8f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6a27 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.748179:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99affed96 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.748193:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99affed96 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.748204:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99affed96 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.748216:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affed9d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.748221:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affed9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.748225:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affed9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.748376:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9ca00/0xe3dac0c99affeda4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.748415:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9ca00/0xe3dac0c99affeda4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.748421:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9ca00/0xe3dac0c99affeda4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787841839.748648:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:1.0:1787841839.748654:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787841839.748680:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9ca00/0xe3dac0c99affeda4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.749790:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9ca00/0xe3dac0c99affeda4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.749814:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99affed96 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.749820:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99affed96 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.749825:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99affed96 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.749829:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cc00d9d400 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:1.0:1787841839.749833:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99affed96 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.749839:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99affed96 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.749853:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92cbc57e3e00) 00010000:00010000:1.0:1787841839.749873:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787841839.749881:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99affed96 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.749888:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99affed96 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.749910:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affed9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.749916:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affed9d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.749921:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affed9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.749924:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cc00d9d600 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:1.0:1787841839.749926:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affed9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.749929:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affed9d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.749934:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff92cbd1fc7d00) 00010000:00010000:1.0:1787841839.749936:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787841839.749938:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affed9d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.749941:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affed9d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.749984:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affed8f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a27 expref: 46 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.750004:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9ca00/0xe3dac0c99affeda4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a27 expref: 45 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.750009:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92cbd1fc7c00) 00010000:00010000:1.0:1787841839.750011:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787841839.750013:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cc00d9ca00, rc 0) 00000100:00100000:1.0:1787841839.750118:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf90c21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+45:11459:x1874687695069440:12345-192.168.201.1@tcp:101:stat.0 Request processed in 2071us (2285us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841839.750125:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 158 00000100:00100000:3.0:1787841839.816051:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841839.816130:0:12018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695069696 00000100:00100000:1.0:1787841839.816141:0:12018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695069696 00000100:00100000:1.0:1787841839.816211:0:12018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 159 00000100:00100000:1.0:1787841839.816223:0:12018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6c69e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b2767a54-6703-4908-8414-eab6601e2ceb+45:11469:x1874687695069696:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:1.0:1787841839.816260:0:12018:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841839.816289:0:12018:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affedab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6a2e expref: -99 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787841839.816467:0:12018:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1787841839.816604:0:12018:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affedab lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a2e expref: 47 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.816623:0:12018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92cbd1fc7e00) 00010000:00010000:1.0:1787841839.816626:0:12018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787841839.816632:0:12018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affedab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a2e expref: 47 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.816674:0:12018:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cc00d9de00, rc 0) 00000100:00100000:1.0:1787841839.816808:0:12018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6c69e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b2767a54-6703-4908-8414-eab6601e2ceb+46:11469:x1874687695069696:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 587us (768us total) trans 4294967445 rc 301/301 00000100:00100000:1.0:1787841839.816817:0:12018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 159 00000100:00100000:0.0:1787841839.818515:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841839.818631:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695069952 00000100:00100000:3.0:1787841839.818643:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695069952 00000100:00100000:0.0:1787841839.818738:0:12373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 44 00000100:00100000:0.0:1787841839.818753:0:12373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbc73eec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b2767a54-6703-4908-8414-eab6601e2ceb+46:11469:x1874687695069952:12345-192.168.201.1@tcp:35:lfs.0 00000100:00100000:0.0:1787841839.819087:0:12373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbc73eec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b2767a54-6703-4908-8414-eab6601e2ceb+47:11469:x1874687695069952:12345-192.168.201.1@tcp:35:lfs.0 Request processed in 338us (582us total) trans 4294967446 rc 0/0 00000100:00100000:0.0:1787841839.819100:0:12373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 44 00000100:00100000:0.0:1787841839.850309:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841839.850559:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695070208 00000100:00100000:2.0:1787841839.850575:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695070208 00000100:00100000:2.0:1787841839.850761:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 160 00000100:00100000:2.0:1787841839.850774:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbc3dcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+47:11475:x1874687695070208:12345-192.168.201.1@tcp:101:bash.0 00010000:00010000:2.0:1787841839.850808:0:9449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841839.850836:0:9449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105e00/0xe3dac0c99affedb9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6a35 expref: -99 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841839.850972:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105400/0xe3dac0c99affedc0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841839.850990:0:9449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9ca00/0xe3dac0c99affeda4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a27 expref: 48 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841839.851000:0:9449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105400/0xe3dac0c99affedc0 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841839.851043:0:9449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9ca00/0xe3dac0c99affeda4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a27 expref: 48 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841839.851060:0:9449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9ca00/0xe3dac0c99affeda4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a27 expref: 48 pid: 5837 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841839.851077:0:9449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4bb0b40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9449:1874687714996352:192.168.201.1@tcp:104: 00000100:00100000:2.0:1787841839.851224:0:9449:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc6555e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787841839.853935:0:9449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4bb0b40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9449:1874687714996352:192.168.201.1@tcp:104: 00010000:00010000:2.0:1787841839.853984:0:9449:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105400/0xe3dac0c99affedc0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841839.854275:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841839.854821:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695070336 00000100:00100000:1.0:1787841839.854832:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695070336 00010000:00010000:1.0:1787841839.854885:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9ca00/0xe3dac0c99affeda4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a27 expref: 49 pid: 5837 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841839.854967:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 66 00000100:00100000:1.0:1787841839.854978:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff4d43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b2767a54-6703-4908-8414-eab6601e2ceb+49:2357:x1874687695070336:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787841839.855000:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787841839.855008:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9ca00/0xe3dac0c99affeda4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a27 expref: 49 pid: 5837 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.855031:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9ca00/0xe3dac0c99affeda4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a27 expref: 49 pid: 5837 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.855061:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9ca00/0xe3dac0c99affeda4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a27 expref: 49 pid: 5837 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.855081:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92cbd1fc7c00) 00010000:00010000:1.0:1787841839.855087:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105400/0xe3dac0c99affedc0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.855097:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105400/0xe3dac0c99affedc0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.855119:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105400/0xe3dac0c99affedc0 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.855161:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787841839.855240:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff4d43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b2767a54-6703-4908-8414-eab6601e2ceb+48:2357:x1874687695070336:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 263us (966us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841839.855248:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 66 00010000:00010000:2.0:1787841839.855310:0:9449:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105400/0xe3dac0c99affedc0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841839.855318:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105400/0xe3dac0c99affedc0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787841839.855359:0:9449:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:2.0:1787841839.855575:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105e00/0xe3dac0c99affedb9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a35 expref: 49 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841839.855593:0:9449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105400/0xe3dac0c99affedc0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a35 expref: 48 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841839.855600:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92cbd1fc7c00) 00010000:00010000:2.0:1787841839.855615:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787841839.855618:0:9449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc6105400, rc 0) 00000100:00100000:2.0:1787841839.855651:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbc3dcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+48:11475:x1874687695070208:12345-192.168.201.1@tcp:101:bash.0 Request processed in 4880us (5360us total) trans 4294967447 rc 0/0 00000100:00100000:2.0:1787841839.855659:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 160 00000100:00100000:3.0:1787841839.858341:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841839.858463:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695070592 00000100:00100000:2.0:1787841839.858477:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695070592 00000100:00100000:2.0:1787841839.858562:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 161 00000100:00100000:2.0:1787841839.858573:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6c6a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2767a54-6703-4908-8414-eab6601e2ceb+48:11475:x1874687695070592:12345-192.168.201.1@tcp:36:bash.0 00010000:00010000:2.0:1787841839.858989:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105000/0xe3dac0c99affedce lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841839.859006:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105000/0xe3dac0c99affedce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841839.859018:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105000/0xe3dac0c99affedce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787841839.859075:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:2.0:1787841839.859098:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000037d14942 reply state 00000000df5ad746 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105000/0xe3dac0c99affedce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841839.859105:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787841839.859210:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6c6a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2767a54-6703-4908-8414-eab6601e2ceb+51:11475:x1874687695070592:12345-192.168.201.1@tcp:36:bash.0 Request processed in 638us (891us total) trans 4294967449 rc 0/0 00000100:00100000:2.0:1787841839.859218:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 161 00000020:00080000:2.0:1787841839.859223:0:5838:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787841839.862836:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105000/0xe3dac0c99affedce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841839.862859:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105000/0xe3dac0c99affedce lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841839.862868:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105000/0xe3dac0c99affedce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841839.862875:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6105000 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:0.0:1787841839.862881:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105000/0xe3dac0c99affedce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841839.862889:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105000/0xe3dac0c99affedce lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841839.862911:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92cbd1fc7c00) 00010000:00010000:0.0:1787841839.862915:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841839.862921:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105000/0xe3dac0c99affedce lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841839.862928:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105000/0xe3dac0c99affedce lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841839.871100:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841839.871545:0:12018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695070720 00000100:00100000:3.0:1787841839.871559:0:12018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695070720 00000100:00100000:3.0:1787841839.871779:0:12018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 162 00000100:00100000:3.0:1787841839.871792:0:12018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbd4bb0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b2767a54-6703-4908-8414-eab6601e2ceb+50:11475:x1874687695070720:12345-192.168.201.1@tcp:101:bash.0 00010000:00010000:3.0:1787841839.871826:0:12018:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841839.871853:0:12018:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149de00/0xe3dac0c99affedd5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6a3c expref: -99 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841839.871967:0:12018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affeddc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841839.871984:0:12018:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105400/0xe3dac0c99affedc0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a35 expref: 51 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841839.871993:0:12018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affeddc lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841839.872038:0:12018:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105400/0xe3dac0c99affedc0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a35 expref: 51 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841839.872078:0:12018:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105400/0xe3dac0c99affedc0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a35 expref: 51 pid: 9449 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841839.872095:0:12018:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6c69a40 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12018:1874687714996480:192.168.201.1@tcp:104: 00000100:00100000:3.0:1787841839.872222:0:12018:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc3022f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787841839.876845:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841839.877385:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695070848 00000100:00100000:0.0:1787841839.877399:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695070848 00000100:00100000:1.0:1787841839.877852:0:12018:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6c69a40 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12018:1874687714996480:192.168.201.1@tcp:104: 00010000:00010000:1.0:1787841839.877891:0:12018:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affeddc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841839.878537:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105400/0xe3dac0c99affedc0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a35 expref: 52 pid: 9449 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841839.878591:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 67 00000100:00100000:0.0:1787841839.878807:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6c6b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b2767a54-6703-4908-8414-eab6601e2ceb+52:2356:x1874687695070848:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787841839.878827:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787841839.878843:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105400/0xe3dac0c99affedc0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a35 expref: 52 pid: 9449 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841839.878857:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105400/0xe3dac0c99affedc0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a35 expref: 52 pid: 9449 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841839.878886:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105400/0xe3dac0c99affedc0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a35 expref: 52 pid: 9449 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841839.878903:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92cbd1fc7c00) 00010000:00010000:0.0:1787841839.878909:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affeddc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841839.878919:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affeddc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841839.878927:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affeddc lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841839.878967:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787841839.879040:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6c6b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b2767a54-6703-4908-8414-eab6601e2ceb+51:2356:x1874687695070848:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 439us (2215us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841839.879049:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 67 00010000:00010000:2.0:1787841839.879138:0:12018:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affeddc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841839.879147:0:12018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affeddc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787841839.879211:0:12018:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1787841839.879218:0:12018:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787841839.879242:0:12018:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affeddc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841839.879281:0:12018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149de00/0xe3dac0c99affedd5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a3c expref: 51 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841839.879306:0:12018:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affeddc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a3c expref: 50 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841839.879314:0:12018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92cbd1fc7c00) 00010000:00010000:2.0:1787841839.879317:0:12018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787841839.879320:0:12018:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc149d600, rc 0) 00000100:00100000:2.0:1787841839.879361:0:12018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbd4bb0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b2767a54-6703-4908-8414-eab6601e2ceb+50:11475:x1874687695070720:12345-192.168.201.1@tcp:101:bash.0 Request processed in 7572us (8278us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841839.879369:0:12018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 162 00000100:00100000:1.0:1787841839.891052:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841839.891258:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695071104 00000100:00100000:2.0:1787841839.891276:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695071104 00000100:00100000:2.0:1787841839.891366:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 45 00000100:00100000:2.0:1787841839.891380:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd7a4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b2767a54-6703-4908-8414-eab6601e2ceb+50:11475:x1874687695071104:12345-192.168.201.1@tcp:35:bash.0 00000100:00100000:2.0:1787841839.891889:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd7a4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b2767a54-6703-4908-8414-eab6601e2ceb+51:11475:x1874687695071104:12345-192.168.201.1@tcp:35:bash.0 Request processed in 511us (851us total) trans 4294967450 rc 0/0 00000100:00100000:2.0:1787841839.891899:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 45 00000001:00080000:0.0:1787841839.916313:0:7643:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:0.0:1787841839.916343:0:7643:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000100:00100000:2.0:1787841839.950585:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841839.950661:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695071360 00000100:00100000:0.0:1787841839.950674:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695071360 00000100:00100000:0.0:1787841839.950911:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 163 00000100:00100000:0.0:1787841839.950924:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbd4bb21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+51:11485:x1874687695071360:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:0.0:1787841839.950984:0:9449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841839.951011:0:9449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a800/0xe3dac0c99affede3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6a43 expref: -99 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787841839.951201:0:9449:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1787841839.951341:0:9449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a800/0xe3dac0c99affede3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a43 expref: 53 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841839.951369:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92cbd1fc7e00) 00010000:00010000:0.0:1787841839.951372:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787841839.951376:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a800/0xe3dac0c99affede3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a43 expref: 53 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841839.951390:0:9449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbffa3a800, rc 0) 00000100:00100000:0.0:1787841839.951477:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbd4bb21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+52:11485:x1874687695071360:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 555us (903us total) trans 4294967451 rc 301/301 00000100:00100000:0.0:1787841839.951484:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 163 00000100:00100000:3.0:1787841839.955023:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841839.956718:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695071488 00000100:00100000:1.0:1787841839.956735:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695071488 00000100:00100000:1.0:1787841839.956813:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 164 00000100:00100000:1.0:1787841839.956826:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6c6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+52:11485:x1874687695071488:12345-192.168.201.1@tcp:34:lfs.0 00010000:00010000:1.0:1787841839.957250:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affedf1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.957272:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affedf1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.957285:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affedf1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.957302:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affedf8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.957309:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affedf8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.957335:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affedf8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.957481:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99affedff lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.957490:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99affedff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.957498:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99affedff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787841839.957551:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99affedff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.957566:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affedf1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.957573:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affedf1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.957579:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affedf1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.957586:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cc00d9de00 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:1.0:1787841839.957590:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affedf1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.957598:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affedf1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.957788:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92cbc57e3e00) 00010000:00010000:1.0:1787841839.957797:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787841839.957803:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affedf1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.957811:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affedf1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.957827:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affedf8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.957833:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affedf8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.957839:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affedf8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.957845:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cc00d9d600 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:1.0:1787841839.957847:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affedf8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.957854:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affedf8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.957862:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff92cbd1fc7900) 00010000:00010000:1.0:1787841839.957864:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787841839.957929:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affedf8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.957937:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affedf8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.957954:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99affedff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.957967:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99affedff lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.957972:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99affedff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.957977:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cc00d9d400 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:1.0:1787841839.957980:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99affedff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.957985:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99affedff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.957993:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92cbd1fc7c00) 00010000:00010000:1.0:1787841839.957995:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787841839.957998:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99affedff lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.958003:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99affedff lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841839.958296:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6c6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+52:11485:x1874687695071488:12345-192.168.201.1@tcp:34:lfs.0 Request processed in 1468us (3281us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841839.958307:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 164 00000100:00100000:1.0:1787841839.961901:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841839.961959:0:12373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695071744 00000100:00100000:0.0:1787841839.961970:0:12373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695071744 00000100:00100000:1.0:1787841839.962050:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 46 00000100:00100000:1.0:1787841839.962063:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e28b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b2767a54-6703-4908-8414-eab6601e2ceb+52:11485:x1874687695071744:12345-192.168.201.1@tcp:35:lfs.0 00000100:00100000:1.0:1787841839.962536:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e28b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b2767a54-6703-4908-8414-eab6601e2ceb+53:11485:x1874687695071744:12345-192.168.201.1@tcp:35:lfs.0 Request processed in 476us (648us total) trans 4294967452 rc 0/0 00000100:00100000:1.0:1787841839.962565:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 46 00000100:00100000:2.0:1787841839.988989:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841839.989184:0:12018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695072000 00000100:00100000:1.0:1787841839.989198:0:12018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695072000 00000100:00100000:1.0:1787841839.989405:0:12018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 165 00000100:00100000:1.0:1787841839.989416:0:12018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbd4bb03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b2767a54-6703-4908-8414-eab6601e2ceb+53:11488:x1874687695072000:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:1.0:1787841839.990208:0:12018:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841839.990248:0:12018:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99affee06 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6a4a expref: -99 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.990360:0:12018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affee0d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.990378:0:12018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affee0d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.990393:0:12018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affee0d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.990410:0:12018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affee14 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.990416:0:12018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affee14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.990424:0:12018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affee14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.990788:0:12018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9dc00/0xe3dac0c99affee1b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.990814:0:12018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9dc00/0xe3dac0c99affee1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.990819:0:12018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9dc00/0xe3dac0c99affee1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787841839.990829:0:12018:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1787841839.990945:0:12018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affee0d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.990951:0:12018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affee0d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.990956:0:12018:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affee0d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.990960:0:12018:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cc00d9d600 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:1.0:1787841839.990963:0:12018:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affee0d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.990968:0:12018:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affee0d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.990979:0:12018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92cbc57e3e00) 00010000:00010000:1.0:1787841839.990981:0:12018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787841839.990985:0:12018:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affee0d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.990990:0:12018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affee0d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.991002:0:12018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affee14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.991010:0:12018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affee14 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.991014:0:12018:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affee14 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.991017:0:12018:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cc00d9de00 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:1.0:1787841839.991019:0:12018:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affee14 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.991022:0:12018:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affee14 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.991026:0:12018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff92cbd1fc7900) 00010000:00010000:1.0:1787841839.991027:0:12018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787841839.991029:0:12018:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affee14 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.991032:0:12018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affee14 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.991072:0:12018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99affee06 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a4a expref: 56 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.991082:0:12018:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9dc00/0xe3dac0c99affee1b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a4a expref: 55 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841839.991087:0:12018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92cbd1fc7c00) 00010000:00010000:1.0:1787841839.991089:0:12018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787841839.991096:0:12018:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cc00d9dc00, rc 0) 00000100:00100000:1.0:1787841839.991173:0:12018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbd4bb03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b2767a54-6703-4908-8414-eab6601e2ceb+55:11488:x1874687695072000:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 1760us (2202us total) trans 4294967453 rc 0/0 00000100:00100000:1.0:1787841839.991184:0:12018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 165 00000100:00100000:3.0:1787841839.993996:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841839.994425:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695072128 00000100:00100000:0.0:1787841839.994452:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695072128 00000100:00100000:0.0:1787841839.994567:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 166 00000100:00100000:0.0:1787841839.994580:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6c69a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+55:11488:x1874687695072128:12345-192.168.201.1@tcp:54:lfs.0 00010000:00010000:0.0:1787841839.994688:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a800/0xe3dac0c99affee29 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841839.994736:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a800/0xe3dac0c99affee29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841839.994766:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a800/0xe3dac0c99affee29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841839.994795:0:9449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a800/0xe3dac0c99affee29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841839.994800:0:9449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a800/0xe3dac0c99affee29 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841839.994805:0:9449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a800/0xe3dac0c99affee29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841839.994809:0:9449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbffa3a800 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:0.0:1787841839.994813:0:9449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a800/0xe3dac0c99affee29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841839.994818:0:9449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a800/0xe3dac0c99affee29 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841839.994827:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92cbd1fc7c00) 00010000:00010000:0.0:1787841839.994829:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787841839.994833:0:9449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a800/0xe3dac0c99affee29 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841839.994837:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a800/0xe3dac0c99affee29 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841839.994916:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6c69a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+55:11488:x1874687695072128:12345-192.168.201.1@tcp:54:lfs.0 Request processed in 339us (932us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841839.994924:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 166 00000100:00100000:2.0:1787841839.996653:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841839.997050:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695072256 00000100:00100000:3.0:1787841839.997063:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695072256 00000100:00100000:3.0:1787841839.997212:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 12 00000100:00100000:3.0:1787841839.997222:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf8e80000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b2767a54-6703-4908-8414-eab6601e2ceb+55:2356:x1874687695072256:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787841839.997250:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787841839.997278:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9dc00/0xe3dac0c99affee1b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a4a expref: 55 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841839.997296:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92cbd1fc7c00) 00010000:00010000:3.0:1787841839.997300:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787841839.997356:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf8e80000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b2767a54-6703-4908-8414-eab6601e2ceb+54:2356:x1874687695072256:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 135us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841839.997363:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 12 00000100:00100000:3.0:1787841839.998073:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841839.998140:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695072512 00000100:00100000:0.0:1787841839.998165:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695072512 00000100:00100000:0.0:1787841839.998214:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 47 00000100:00100000:0.0:1787841839.998224:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff42ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b2767a54-6703-4908-8414-eab6601e2ceb+54:11488:x1874687695072512:12345-192.168.201.1@tcp:35:lfs.0 00000100:00100000:0.0:1787841839.998490:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff42ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b2767a54-6703-4908-8414-eab6601e2ceb+55:11488:x1874687695072512:12345-192.168.201.1@tcp:35:lfs.0 Request processed in 268us (419us total) trans 4294967454 rc 0/0 00000100:00100000:0.0:1787841839.998497:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 47 00000100:00100000:2.0:1787841840.097498:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841840.097580:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695072768 00000100:00100000:1.0:1787841840.097593:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695072768 00000100:00100000:1.0:1787841840.097668:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 167 00000100:00100000:1.0:1787841840.097680:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf8e821c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+55:11506:x1874687695072768:12345-192.168.201.1@tcp:101:cat.0 00010000:00010000:1.0:1787841840.097748:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841840.097776:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99affee30 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6a51 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841840.097913:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affee37 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841840.097929:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affee37 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841840.097942:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affee37 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787841840.097952:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1787841840.098112:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99affee30 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a51 expref: 58 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841840.098130:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affee37 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a51 expref: 57 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841840.098136:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92cbd1fc7c00) 00010000:00010000:1.0:1787841840.098154:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787841840.098158:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cc00d9de00, rc 0) 00000100:00100000:1.0:1787841840.098232:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf8e821c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+57:11506:x1874687695072768:12345-192.168.201.1@tcp:101:cat.0 Request processed in 555us (750us total) trans 4294967455 rc 0/0 00000100:00100000:1.0:1787841840.098240:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 167 00000100:00100000:3.0:1787841840.114437:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841840.114623:0:12018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695072896 00000100:00100000:1.0:1787841840.114637:0:12018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695072896 00000100:00100000:1.0:1787841840.114792:0:12018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 168 00000100:00100000:1.0:1787841840.114805:0:12018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff42c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b2767a54-6703-4908-8414-eab6601e2ceb+57:11507:x1874687695072896:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:1.0:1787841840.114843:0:12018:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841840.115134:0:12018:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99affee45 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6a58 expref: -99 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841840.115226:0:12018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affee4c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841840.115240:0:12018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affee4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841840.115250:0:12018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affee4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787841840.115323:0:12018:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:1.0:1787841840.115326:0:12018:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787841840.115358:0:12018:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affee4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841840.115396:0:12018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99affee45 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a58 expref: 59 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841840.115446:0:12018:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affee4c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a58 expref: 58 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841840.115455:0:12018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92cbc57e3e00) 00010000:00010000:1.0:1787841840.115459:0:12018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787841840.115464:0:12018:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cc00d9d600, rc 0) 00000100:00100000:1.0:1787841840.115598:0:12018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff42c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b2767a54-6703-4908-8414-eab6601e2ceb+58:11507:x1874687695072896:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 797us (1178us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841840.115606:0:12018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 168 00000100:00100000:2.0:1787841840.121190:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841840.121250:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695073280 00000100:00100000:1.0:1787841840.121263:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695073280 00000100:00100000:1.0:1787841840.121335:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 48 00000100:00100000:1.0:1787841840.121358:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf8e81a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b2767a54-6703-4908-8414-eab6601e2ceb+58:11507:x1874687695073280:12345-192.168.201.1@tcp:35:lfs.0 00000100:00100000:1.0:1787841840.121843:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf8e81a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b2767a54-6703-4908-8414-eab6601e2ceb+59:11507:x1874687695073280:12345-192.168.201.1@tcp:35:lfs.0 Request processed in 496us (814us total) trans 4294967456 rc 0/0 00000100:00100000:1.0:1787841840.121849:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 48 00000100:00100000:2.0:1787841840.125212:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841840.125322:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695073408 00000100:00100000:1.0:1787841840.125335:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695073408 00000100:00100000:1.0:1787841840.125433:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 13 00000100:00100000:1.0:1787841840.125445:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf8e80f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b2767a54-6703-4908-8414-eab6601e2ceb+59:11507:x1874687695073408:12345-192.168.201.1@tcp:103:lfs.0 00010000:00010000:1.0:1787841840.125470:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787841840.125498:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affeddc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a3c expref: 59 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841840.125519:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affee37 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a51 expref: 58 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841840.125549:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c400/0xe3dac0c99affece7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d69fd expref: 57 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841840.125560:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92cbd1fc7c00) 00010000:00010000:1.0:1787841840.125573:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787841840.125644:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf8e80f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b2767a54-6703-4908-8414-eab6601e2ceb+56:11507:x1874687695073408:12345-192.168.201.1@tcp:103:lfs.0 Request processed in 201us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841840.125651:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 13 00000100:00100000:3.0:1787841840.131023:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841840.131148:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695073536 00000100:00100000:0.0:1787841840.131161:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695073536 00000100:00100000:0.0:1787841840.131252:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 169 00000100:00100000:0.0:1787841840.131265:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff408000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+56:11507:x1874687695073536:12345-192.168.201.1@tcp:58:lfs.0 00010000:00010000:0.0:1787841840.131432:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a800/0xe3dac0c99affee53 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841840.131454:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a800/0xe3dac0c99affee53 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841840.131470:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a800/0xe3dac0c99affee53 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787841840.131777:0:9449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:0.0:1787841840.131909:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff408000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+56:11507:x1874687695073536:12345-192.168.201.1@tcp:58:lfs.0 Request processed in 643us (899us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841840.131920:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 169 00000100:00100000:2.0:1787841840.161188:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841840.161662:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695073664 00000100:00100000:1.0:1787841840.161675:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695073664 00000100:00100000:1.0:1787841840.161799:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 170 00000100:00100000:1.0:1787841840.161812:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf8e80780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+56:11509:x1874687695073664:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:1.0:1787841840.161842:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841840.161870:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affee5a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6a5f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841840.162005:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99affee61 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841840.162023:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99affee61 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841840.162507:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99affee61 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841840.162533:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c600/0xe3dac0c99affee68 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841840.162553:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c600/0xe3dac0c99affee68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841840.162561:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c600/0xe3dac0c99affee68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841840.162691:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d000/0xe3dac0c99affee6f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841840.162808:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d000/0xe3dac0c99affee6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841840.162816:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d000/0xe3dac0c99affee6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787841840.163495:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1787841840.163503:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787841840.163667:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d000/0xe3dac0c99affee6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841840.163687:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d000/0xe3dac0c99affee6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841840.163822:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99affee61 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841840.163830:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99affee61 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841840.163838:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99affee61 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841840.163843:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cc00d9d400 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:0.0:1787841840.163848:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99affee61 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841840.163856:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99affee61 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841840.164022:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92cbc57e3e00) 00010000:00010000:0.0:1787841840.164026:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841840.164032:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99affee61 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841840.164040:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99affee61 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841840.164061:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c600/0xe3dac0c99affee68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841840.164068:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c600/0xe3dac0c99affee68 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841840.164074:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c600/0xe3dac0c99affee68 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841840.164089:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cc00d9c600 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:0.0:1787841840.164092:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c600/0xe3dac0c99affee68 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841840.164098:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c600/0xe3dac0c99affee68 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841840.164107:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff92cbd1fc7c00) 00010000:00010000:0.0:1787841840.164109:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841840.164112:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c600/0xe3dac0c99affee68 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841840.164118:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c600/0xe3dac0c99affee68 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841840.164173:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affee5a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a5f expref: 58 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841840.164190:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d000/0xe3dac0c99affee6f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a5f expref: 57 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841840.164198:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92cbc57e3f00) 00010000:00010000:0.0:1787841840.164201:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787841840.164203:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cc00d9d000, rc 0) 00000100:00100000:0.0:1787841840.164472:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf8e80780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+57:11509:x1874687695073664:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 2659us (3296us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841840.164483:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 170 00000040:00080000:0.0:1787841840.513225:0:11682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787841840.513251:0:11682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787841840.513299:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1787841840.513308:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787841840.514668:0:11682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbe99c70c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11682:1874687714996608:192.168.201.1@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787841840.521768:0:11682:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbd1ff9a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787841840.535497:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841840.535588:0:12018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695073792 00000100:00100000:3.0:1787841840.535620:0:12018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695073792 00000100:00100000:3.0:1787841840.535754:0:12018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 171 00000100:00100000:3.0:1787841840.535768:0:12018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe99c5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b2767a54-6703-4908-8414-eab6601e2ceb+58:11520:x1874687695073792:12345-192.168.201.1@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787841840.535822:0:12018:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787841840.535980:0:12018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe99c5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b2767a54-6703-4908-8414-eab6601e2ceb+58:11520:x1874687695073792:12345-192.168.201.1@tcp:53:lhsmtool_posix.0 Request processed in 215us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841840.535990:0:12018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 171 00000100:00100000:1.0:1787841840.537913:0:11682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbe99c70c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11682:1874687714996608:192.168.201.1@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787841840.543326:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841840.544211:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695073920 00000100:00100000:3.0:1787841840.544227:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695073920 00000100:00100000:3.0:1787841840.544310:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 172 00000100:00100000:3.0:1787841840.544324:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe99c70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2767a54-6703-4908-8414-eab6601e2ceb+57:11520:x1874687695073920:12345-192.168.201.1@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787841840.544441:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affee76 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841840.544463:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affee76 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841840.544478:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affee76 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841840.544495:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affee7d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841840.544503:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affee7d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841840.544509:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affee7d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841840.544555:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affee84 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841840.544582:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affee84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841840.544590:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affee84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787841840.544640:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1787841840.544645:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787841840.544659:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affee84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841840.544673:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affee76 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841840.544681:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affee76 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841840.544690:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affee76 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841840.544739:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc149c400 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:3.0:1787841840.544750:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affee76 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841840.544761:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affee76 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841840.544775:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff92cbc57e3b00) 00010000:00010000:3.0:1787841840.544779:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787841840.544784:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affee76 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841840.544802:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affee76 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841840.544821:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affee7d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841840.544828:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affee7d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841840.544833:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affee7d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841840.544838:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc149c000 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:3.0:1787841840.544841:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affee7d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841840.544848:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affee7d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841840.544856:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff92cbc89cd900) 00010000:00010000:3.0:1787841840.544859:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787841840.544862:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affee7d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841840.544868:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affee7d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841840.544884:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affee84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841840.544890:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affee84 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841840.544902:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affee84 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841840.544907:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc149d400 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:3.0:1787841840.544910:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affee84 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841840.544916:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affee84 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841840.544925:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92cbc57e3f00) 00010000:00010000:3.0:1787841840.544927:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787841840.544930:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affee84 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841840.544937:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affee84 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841840.545048:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe99c70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2767a54-6703-4908-8414-eab6601e2ceb+57:11520:x1874687695073920:12345-192.168.201.1@tcp:34:lhsmtool_posix.0 Request processed in 725us (1736us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841840.545058:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 172 00000100:00100000:3.0:1787841840.558882:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841840.559118:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695074176 00000100:00100000:0.0:1787841840.559130:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695074176 00000100:00100000:0.0:1787841840.559310:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 173 00000100:00100000:0.0:1787841840.559322:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff408f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+57:11520:x1874687695074176:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787841840.559363:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841840.559393:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a600/0xe3dac0c99affee8b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6a66 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841840.559599:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3ae00/0xe3dac0c99affee92 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841840.559621:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3ae00/0xe3dac0c99affee92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841840.559636:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3ae00/0xe3dac0c99affee92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787841840.559652:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1787841840.559853:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3ae00/0xe3dac0c99affee92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841840.559862:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3ae00/0xe3dac0c99affee92 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841840.559907:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3ae00/0xe3dac0c99affee92 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841840.559914:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbffa3ae00 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:0.0:1787841840.559920:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3ae00/0xe3dac0c99affee92 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841840.559930:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3ae00/0xe3dac0c99affee92 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841840.559944:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92cbc57e3f00) 00010000:00010000:0.0:1787841840.559948:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787841840.559954:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3ae00/0xe3dac0c99affee92 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841840.559962:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3ae00/0xe3dac0c99affee92 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841840.560017:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a600/0xe3dac0c99affee8b lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a66 expref: 59 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841840.560029:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff92cbc57e3b00) 00010000:00010000:0.0:1787841840.560032:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787841840.560037:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a600/0xe3dac0c99affee8b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a66 expref: 59 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841840.560046:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbffa3a600, rc 0) 00000100:00100000:0.0:1787841840.562875:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff408f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+58:11520:x1874687695074176:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 Request processed in 3533us (3989us total) trans 4294967457 rc 301/301 00000100:00100000:0.0:1787841840.562938:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 173 00000100:00100000:1.0:1787841840.571867:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841840.571961:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695074304 00000100:00100000:0.0:1787841840.571975:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695074304 00000100:00100000:0.0:1787841840.572051:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 174 00000100:00100000:0.0:1787841840.572064:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e2a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+58:11520:x1874687695074304:12345-192.168.201.1@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787841840.572125:0:9449:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787841840.572283:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e2a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+58:11520:x1874687695074304:12345-192.168.201.1@tcp:53:lhsmtool_posix.0 Request processed in 221us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841840.572292:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 174 00000100:00100000:0.0:1787841840.584010:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841840.584466:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695074560 00000100:00100000:0.0:1787841840.584482:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695074560 00000100:00100000:0.0:1787841840.585257:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 175 00000100:00100000:0.0:1787841840.585274:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cc00dde940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+58:11520:x1874687695074560:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787841840.585306:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841840.585310:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787841840.585363:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affee4c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a58 expref: 58 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841840.585394:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92cbc57e3e00) 00010000:00010000:0.0:1787841840.585402:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787841840.585421:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a600/0xe3dac0c99affeea0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6a6d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787841840.588635:0:5837:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:3.0:1787841840.589634:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affeea7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841840.589662:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affeea7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841840.589678:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affeea7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841840.589823:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a600/0xe3dac0c99affeea0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a6d expref: 60 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841840.589843:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affeea7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a6d expref: 59 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841840.589852:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff92cbc89cd900) 00010000:00010000:3.0:1787841840.589855:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787841840.589859:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc149d400, rc 0) 00000100:00100000:3.0:1787841840.589957:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cc00dde940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+59:11520:x1874687695074560:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 Request processed in 4689us (5967us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1787841840.589970:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 175 00000100:00100000:1.0:1787841840.608357:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841840.608690:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695074816 00000100:00100000:0.0:1787841840.608731:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695074816 00000100:00100000:0.0:1787841840.608834:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 176 00000100:00100000:0.0:1787841840.608848:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e29680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+59:11520:x1874687695074816:12345-192.168.201.1@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787841840.608944:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787841840.608983:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affeea7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a6d expref: 59 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841840.609012:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff92cbc89cd900) 00010000:00010000:0.0:1787841840.609033:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787841840.609076:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3ae00/0xe3dac0c99affeeb5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841840.609093:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3ae00/0xe3dac0c99affeeb5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841840.609106:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3ae00/0xe3dac0c99affeeb5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841840.609125:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a200/0xe3dac0c99affeebc lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x8a158957 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841840.609132:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a200/0xe3dac0c99affeebc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x8a158957 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841840.609140:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a200/0xe3dac0c99affeebc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x8a158957 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841840.609256:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3ae00/0xe3dac0c99affeeb5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841840.609264:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3ae00/0xe3dac0c99affeeb5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841840.609283:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3ae00/0xe3dac0c99affeeb5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841840.609291:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbffa3ae00 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:0.0:1787841840.609296:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3ae00/0xe3dac0c99affeeb5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841840.609306:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3ae00/0xe3dac0c99affeeb5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841840.609317:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92cbc57e3e00) 00010000:00010000:0.0:1787841840.609321:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841840.609325:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3ae00/0xe3dac0c99affeeb5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841840.609332:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3ae00/0xe3dac0c99affeeb5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841840.609366:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a200/0xe3dac0c99affeebc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x8a158957 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841840.609373:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a200/0xe3dac0c99affeebc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x8a158957 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841840.609380:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a200/0xe3dac0c99affeebc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x8a158957 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841840.609384:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbffa3a200 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:0.0:1787841840.609388:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a200/0xe3dac0c99affeebc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x8a158957 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841840.609405:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a200/0xe3dac0c99affeebc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x8a158957 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841840.609420:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x8a158957 (ffff92cbc57e3700) 00010000:00010000:0.0:1787841840.609424:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841840.609428:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a200/0xe3dac0c99affeebc lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x8a158957 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841840.609434:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a200/0xe3dac0c99affeebc lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x8a158957 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841840.609544:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e29680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+58:11520:x1874687695074816:12345-192.168.201.1@tcp:36:lhsmtool_posix.0 Request processed in 700us (1219us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787841840.609553:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 176 00000100:00100000:1.0:1787841840.614479:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841840.614642:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695074944 00000100:00100000:2.0:1787841840.614657:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695074944 00000100:00100000:3.0:1787841840.614961:0:12018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 177 00000100:00100000:3.0:1787841840.614986:0:12018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e2a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b2767a54-6703-4908-8414-eab6601e2ceb+58:11520:x1874687695074944:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787841840.615015:0:12018:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841840.615043:0:12018:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affeec3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6a74 expref: -99 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841840.615090:0:12018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affeeca lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841840.615106:0:12018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affeeca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841840.615121:0:12018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affeeca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841840.615246:0:12018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affeec3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a74 expref: 60 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841840.615268:0:12018:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affeeca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a74 expref: 59 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841840.615278:0:12018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff92cbc89cd700) 00010000:00010000:3.0:1787841840.615281:0:12018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787841840.615285:0:12018:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc149c400, rc 0) 00000100:00100000:3.0:1787841840.615377:0:12018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e2a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b2767a54-6703-4908-8414-eab6601e2ceb+59:11520:x1874687695074944:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 Request processed in 402us (914us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841840.615385:0:12018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 177 00000100:00100000:0.0:1787841840.630718:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841840.631201:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695075200 00000100:00100000:3.0:1787841840.631212:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695075200 00000100:00100000:3.0:1787841840.631281:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 178 00000100:00100000:3.0:1787841840.631291:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cc00ddd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+59:11520:x1874687695075200:12345-192.168.201.1@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787841840.631404:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affeed1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841840.631423:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affeed1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841840.631436:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affeed1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787841840.631803:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:3.0:1787841840.631815:0:5837:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 380630116268ns, next at 381630113163ns, rc = 0 00000004:00010000:3.0:1787841840.631938:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004013caab reply state 00000000d72980fe transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affeed1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841840.631949:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787841840.632088:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cc00ddd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+61:11520:x1874687695075200:12345-192.168.201.1@tcp:36:lhsmtool_posix.0 Request processed in 796us (1401us total) trans 4294967459 rc 0/0 00000100:00100000:3.0:1787841840.632096:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 178 00010000:00010000:3.0:1787841840.636667:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affeed1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841840.636689:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affeed1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841840.636731:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affeed1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841840.636739:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc149d400 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:3.0:1787841840.636745:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affeed1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841840.636754:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affeed1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841840.636775:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff92cbc89cd700) 00010000:00010000:3.0:1787841840.636779:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787841840.636785:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affeed1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841840.636792:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affeed1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841840.637739:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841840.637854:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695075328 00000100:00100000:3.0:1787841840.637874:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695075328 00000100:00100000:3.0:1787841840.637949:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 179 00000100:00100000:3.0:1787841840.637960:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac2dbf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+60:11520:x1874687695075328:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787841840.638005:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841840.638034:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affeed8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6a7b expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841840.638143:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affeed8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a7b expref: 61 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841840.638162:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affeed8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a7b expref: 61 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841840.638299:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff92cbc89cd700) 00010000:00010000:3.0:1787841840.638304:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787841840.638308:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc149c000, rc 0) 00000100:00100000:3.0:1787841840.638578:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac2dbf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+61:11520:x1874687695075328:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 Request processed in 617us (876us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841840.638587:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 179 00000100:00100000:1.0:1787841840.645361:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841840.646369:0:9572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695075456 00000100:00100000:3.0:1787841840.646390:0:9572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695075456 00000100:00100000:3.0:1787841840.646504:0:9572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 51 00000100:00100000:3.0:1787841840.646518:0:9572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e29a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b2767a54-6703-4908-8414-eab6601e2ceb+6:2356:x1874687695075456:12345-192.168.201.1@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1787841840.647068:0:9572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e29a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b2767a54-6703-4908-8414-eab6601e2ceb+7:2356:x1874687695075456:12345-192.168.201.1@tcp:2:lhsmtool_posix.0 Request processed in 551us (1733us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1787841840.647079:0:9572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 51 00000100:00080000:1.0:1787841840.651807:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787841840.654669:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841840.654839:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695075712 00000100:00100000:0.0:1787841840.654853:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695075712 00000100:00100000:0.0:1787841840.654933:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 49 00000100:00100000:0.0:1787841840.654944:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e29e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b2767a54-6703-4908-8414-eab6601e2ceb+61:11520:x1874687695075712:12345-192.168.201.1@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787841840.659787:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e29e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b2767a54-6703-4908-8414-eab6601e2ceb+62:11520:x1874687695075712:12345-192.168.201.1@tcp:35:lhsmtool_posix.0 Request processed in 4824us (5108us total) trans 4294967460 rc 0/0 00000100:00100000:0.0:1787841840.659809:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 49 00000100:00100000:0.0:1787841840.665859:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841840.665960:0:12018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695075968 00000100:00100000:3.0:1787841840.665985:0:12018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695075968 00000100:00100000:3.0:1787841840.666061:0:12018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 180 00000100:00100000:3.0:1787841840.666083:0:12018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac2dbe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b2767a54-6703-4908-8414-eab6601e2ceb+62:11520:x1874687695075968:12345-192.168.201.1@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787841840.666483:0:12018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac2dbe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b2767a54-6703-4908-8414-eab6601e2ceb+62:11520:x1874687695075968:12345-192.168.201.1@tcp:57:lhsmtool_posix.0 Request processed in 411us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841840.666492:0:12018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 180 00000100:00100000:1.0:1787841840.674343:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841840.676076:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695076096 00000100:00100000:3.0:1787841840.676103:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695076096 00000100:00100000:3.0:1787841840.676186:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 181 00000100:00100000:3.0:1787841840.676198:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e283c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+62:11520:x1874687695076096:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787841840.676230:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841840.676259:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affeedf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6a82 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841840.676365:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affeee6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841840.676392:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affeee6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841840.676407:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affeee6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787841840.676464:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787841840.676490:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affeee6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841840.676529:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affeedf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a82 expref: 64 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841840.676564:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affeee6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a82 expref: 63 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841840.676575:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff92cbc89cd700) 00010000:00010000:3.0:1787841840.676578:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787841840.676583:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc149d600, rc 0) 00000100:00100000:3.0:1787841840.676683:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e283c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+63:11520:x1874687695076096:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 Request processed in 487us (2366us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841840.676692:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 181 00000100:00100000:2.0:1787841840.692675:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841840.693014:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695076224 00000100:00100000:3.0:1787841840.693027:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695076224 00000100:00100000:0.0:1787841840.693394:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 52 00000100:00100000:0.0:1787841840.693409:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf8e80b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b2767a54-6703-4908-8414-eab6601e2ceb+7:2355:x1874687695076224:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787841840.693447:0:6687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841840.693478:0:6687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096c683fd/0xe3dac0c99affeeed lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6a89 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787841840.693516:0:6687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a904d31, blocks: 0x1 00010000:00010000:0.0:1787841840.693542:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=380s v=(0 0) 00010000:00010000:0.0:1787841840.693548:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787841840.693559:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096c683fd/0xe3dac0c99affeeed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a89 expref: 8 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841840.693582:0:6687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000096c683fd/0xe3dac0c99affeeed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a89 expref: 8 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841840.693598:0:6687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbffa3a400, rc 0) 00000100:00100000:0.0:1787841840.693680:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf8e80b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b2767a54-6703-4908-8414-eab6601e2ceb+8:2355:x1874687695076224:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 Request processed in 275us (1022us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841840.693688:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 52 00000100:00100000:0.0:1787841840.696773:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841840.696894:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695076480 00000100:00100000:3.0:1787841840.696907:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695076480 00000100:00100000:3.0:1787841840.696984:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 182 00000100:00100000:3.0:1787841840.696998:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac2dbcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+63:11520:x1874687695076480:12345-192.168.201.1@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787841840.697380:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac2dbcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+63:11520:x1874687695076480:12345-192.168.201.1@tcp:57:lhsmtool_posix.0 Request processed in 384us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841840.697389:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 182 00010000:00010000:1.0:1787841840.705814:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787841840.705854:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841840.705932:0:9572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695076608 00000100:00100000:1.0:1787841840.705945:0:9572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695076608 00000100:00100000:1.0:1787841840.706017:0:9572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 53 00000100:00100000:1.0:1787841840.706029:0:9572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf8dc8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b2767a54-6703-4908-8414-eab6601e2ceb+8:11520:x1874687695076608:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787841840.706053:0:9572:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841840.706222:0:9572:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000022a2dbdf/0xe3dac0c99affeef4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6a90 expref: -99 pid: 9572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841840.706263:0:9572:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000096c683fd/0xe3dac0c99affeeed lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a89 expref: 9 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841840.706273:0:9572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787841840.706278:0:9572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787841840.706284:0:9572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022a2dbdf/0xe3dac0c99affeef4 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a90 expref: 9 pid: 9572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841840.706356:0:9572:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000096c683fd/0xe3dac0c99affeeed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a89 expref: 9 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841840.706373:0:9572:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000096c683fd/0xe3dac0c99affeeed lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a89 expref: 9 pid: 6687 timeout: 480 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841840.706399:0:9572:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac30e6d00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9572:1874687714996736:192.168.201.1@tcp:104: 00000100:00100000:1.0:1787841840.706776:0:9572:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbcd6293c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787841840.714076:0:9572:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac30e6d00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9572:1874687714996736:192.168.201.1@tcp:104: 00010000:00010000:1.0:1787841840.714147:0:9572:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000022a2dbdf/0xe3dac0c99affeef4 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a90 expref: 9 pid: 9572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841840.714180:0:9572:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cc00d9c800, rc 0) 00000100:00100000:1.0:1787841840.714265:0:9572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf8dc8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b2767a54-6703-4908-8414-eab6601e2ceb+9:11520:x1874687695076608:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 Request processed in 8237us (8420us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841840.714291:0:9572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 53 00000100:00100000:1.0:1787841840.716619:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841840.717164:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695076736 00000100:00100000:3.0:1787841840.717180:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695076736 00010000:00010000:3.0:1787841840.717244:0:7632:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000096c683fd/0xe3dac0c99affeeed lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a89 expref: 9 pid: 6687 timeout: 480 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841840.717305:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 68 00000100:00100000:3.0:1787841840.717316:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac30e6d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b2767a54-6703-4908-8414-eab6601e2ceb+9:2357:x1874687695076736:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787841840.717359:0:7632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787841840.717388:0:7632:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000096c683fd/0xe3dac0c99affeeed lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a89 expref: 9 pid: 6687 timeout: 480 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841840.717404:0:7632:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000096c683fd/0xe3dac0c99affeeed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a89 expref: 9 pid: 6687 timeout: 480 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841840.717434:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096c683fd/0xe3dac0c99affeeed lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a89 expref: 9 pid: 6687 timeout: 480 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841840.717455:0:7632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787841840.717460:0:7632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787841840.717471:0:7632:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000022a2dbdf/0xe3dac0c99affeef4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a90 expref: 8 pid: 9572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841840.717483:0:7632:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022a2dbdf/0xe3dac0c99affeef4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a90 expref: 8 pid: 9572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841840.717554:0:7632:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000022a2dbdf/0xe3dac0c99affeef4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a90 expref: 8 pid: 9572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841840.717572:0:7632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac1115680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7632:1874687714996864:192.168.201.1@tcp:105: 00000100:00100000:3.0:1787841840.717731:0:7632:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc6722900 going to sleep for 11 seconds 00000100:00100000:3.0:1787841840.728194:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841840.728373:0:7632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac1115680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7632:1874687714996864:192.168.201.1@tcp:105: 00010000:00010000:0.0:1787841840.728409:0:7632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787841840.728487:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac30e6d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b2767a54-6703-4908-8414-eab6601e2ceb+8:2357:x1874687695076736:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 11172us (11881us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841840.728501:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 68 00000100:00100000:1.0:1787841840.730862:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695076864 00000100:00100000:1.0:1787841840.730902:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695076864 00002000:00100000:1.0:1787841840.730980:0:6694:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff92cac1115a40 x1874687695076864/t0(0) o4->b2767a54-6703-4908-8414-eab6601e2ceb@192.168.201.1@tcp:341/0 lens 504/0 e 0 to 0 dl 1787841851 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787841840.730993:0:6694:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff92cac1115a40 with x1874687695076864 ext(0->8) 00002000:00010000:1.0:1787841840.731000:0:6694:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92cac1115a40 00000100:00100000:1.0:1787841840.731632:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 4 00000100:00100000:1.0:1787841840.731657:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac1115a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b2767a54-6703-4908-8414-eab6601e2ceb+8:2356:x1874687695076864:12345-192.168.201.1@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787841840.733030:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac1115a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b2767a54-6703-4908-8414-eab6601e2ceb+10:2356:x1874687695076864:12345-192.168.201.1@tcp:4:lhsmtool_posix.0 Request processed in 1370us (4840us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1787841840.733462:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 4 00002000:00100000:1.0:1787841840.733479:0:6694:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff92cac1115a40 x1874687695076864/t4294967314(0) o4->b2767a54-6703-4908-8414-eab6601e2ceb@192.168.201.1@tcp:341/0 lens 504/448 e 0 to 0 dl 1787841851 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787841840.733491:0:6694:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff92cac1115a40 with x1874687695076864 ext(0->8) 00002000:00010000:1.0:1787841840.733499:0:6694:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92cac1115a40 00000100:00100000:3.0:1787841840.736870:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841840.738217:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695076992 00000100:00100000:1.0:1787841840.738238:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695076992 00000100:00100000:1.0:1787841840.738349:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 183 00000100:00100000:1.0:1787841840.738361:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac11161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+63:11520:x1874687695076992:12345-192.168.201.1@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1787841840.829726:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:1.0:1787841840.829827:0:5860:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000004:00080000:1.0:1787841840.829868:0:5860:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:1.0:1787841840.829997:0:5860:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff92cbd1fe7300 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:1.0:1787841840.830004:0:5860:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff92cbc4eb6a00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff92cbd1fe7480 00000020:00080000:1.0:1787841840.830007:0:5860:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff92cbc4eb6000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff92cbc9271000 00000100:00100000:3.0:1787841840.830125:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787841840.830159:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac1114f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687714996992:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787841840.830254:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841840.830311:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac11161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+18:11520:x1874687695076992:12345-192.168.201.1@tcp:44:lhsmtool_posix.0 Request processed in 91949us (93453us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841840.830325:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 183 00000020:00080000:2.0:1787841840.830416:0:5871:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:2.0:1787841840.830636:0:5871:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1787841840.830983:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714996992 00000100:00100000:2.0:1787841840.830993:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714996992 00000100:00100000:2.0:1787841840.831058:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787841840.831067:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac1117480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1874687714996992:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1787841840.831238:0:6686:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1787841840.831243:0:6686:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787841841 00002000:00010000:2.0:1787841840.831245:0:6686:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787841840.831248:0:6686:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1787841841 -> 1787841841 00002000:00010000:2.0:1787841840.831250:0:6686:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787841840.838593:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841840.838639:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695077120 00000100:00100000:1.0:1787841840.838652:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695077120 00000100:00100000:1.0:1787841840.838756:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 55 00000100:00100000:1.0:1787841840.838768:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac30e52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b2767a54-6703-4908-8414-eab6601e2ceb+10:2357:x1874687695077120:12345-192.168.201.1@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1787841840.841781:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6df4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874687714997120:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787841840.841884:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841840.841939:0:9572:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1787841840.841952:0:9572:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00080000:2.0:1787841840.841995:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787841840.842013:0:6687:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:2.0:1787841840.842023:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714997120 00000100:00100000:2.0:1787841840.842032:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714997120 00000100:00080000:0.0:1787841840.842127:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787841840.842929:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac1117480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3298:x1874687714996992:12345-0@lo:2:osp-syn-0-0.0 Request processed in 11855us (12668us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1787841840.842943:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787841840.842978:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787841840.842989:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6df70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1874687714997120:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787841840.843030:0:6686:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:2.0:1787841840.843075:0:6686:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a904d2e, atime: 0x6a904d2e, ctime: 0x6a904d2e, blocks: 0xb 00010000:00010000:2.0:1787841840.843085:0:6686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000646dd324/0xe3dac0c99affeefb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841840.843122:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=380s v=(0 0) 00010000:00010000:2.0:1787841840.843127:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787841840.843135:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000646dd324/0xe3dac0c99affeefb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841840.843153:0:6686:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000646dd324/0xe3dac0c99affeefb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841840.843165:0:6686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000646dd324/0xe3dac0c99affeefb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841840.843174:0:6686:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000646dd324/0xe3dac0c99affeefb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841840.843198:0:6686:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787841840.843216:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787841840.843223:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000646dd324/0xe3dac0c99affeefb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841840.843232:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6105400 already unused, calling callback (ffffffffc17a4500) 00010000:00010000:2.0:1787841840.843237:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000646dd324/0xe3dac0c99affeefb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841840.843247:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000646dd324/0xe3dac0c99affeefb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841840.843281:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000646dd324/0xe3dac0c99affeefb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841840.843290:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000646dd324/0xe3dac0c99affeefb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841840.843314:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841840.843317:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841840.843318:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787841840.847288:0:3298:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff92cac1114f00/2, rc 0, transno 4294967315 00000100:00100000:3.0:1787841840.847305:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac1114f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687714996992:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787841840.857454:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6df70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3300:x1874687714997120:12345-0@lo:6:osp-syn-1-0.0 Request processed in 14453us (15555us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1787841840.857473:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787841840.857553:0:3300:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:2.0:1787841840.857561:0:3300:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:2.0:1787841840.857603:0:3300:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff92cbf6df4000 x1874687714997120/t4294967307(4294967307) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787841856 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1787841840.857618:0:3300:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff92cbf6df4000/2, rc 0, transno 4294967307 00000100:00100000:2.0:1787841840.857625:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6df4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874687714997120:0@lo:6:osp-syn-1-0.0 00000001:00080000:1.0:1787841840.920941:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000001:00080000:1.0:1787841840.920971:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:2.0:1787841840.921295:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac30e52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b2767a54-6703-4908-8414-eab6601e2ceb+7:2357:x1874687695077120:12345-192.168.201.1@tcp:16:lhsmtool_posix.0 Request processed in 82520us (82709us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841840.921309:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 55 00000100:00100000:1.0:1787841840.924231:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841840.924954:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695077376 00000100:00100000:3.0:1787841840.924971:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695077376 00000100:00100000:2.0:1787841840.925166:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 184 00000100:00100000:2.0:1787841840.925179:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac30e7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+18:11520:x1874687695077376:12345-192.168.201.1@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787841840.925257:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787841840.925310:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affeee6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a82 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841840.925344:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff92cbc89cd700) 00010000:00010000:2.0:1787841840.925351:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787841840.925449:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105400/0xe3dac0c99affef02 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841840.925467:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105400/0xe3dac0c99affef02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841840.925478:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105400/0xe3dac0c99affef02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787841840.926031:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009147040c reply state 00000000e131f8ea transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105400/0xe3dac0c99affef02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841840.926044:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787841840.926216:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac30e7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+19:11520:x1874687695077376:12345-192.168.201.1@tcp:36:lhsmtool_posix.0 Request processed in 1039us (2000us total) trans 4294967461 rc 0/0 00000100:00100000:2.0:1787841840.926225:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 184 00010000:00010000:1.0:1787841840.928416:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105400/0xe3dac0c99affef02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841840.928439:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105400/0xe3dac0c99affef02 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841840.928447:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105400/0xe3dac0c99affef02 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841840.928454:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6105400 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:1.0:1787841840.928460:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105400/0xe3dac0c99affef02 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841840.928470:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105400/0xe3dac0c99affef02 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841840.928509:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff92cbc89cd700) 00010000:00010000:1.0:1787841840.928511:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787841840.928516:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105400/0xe3dac0c99affef02 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841840.928521:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105400/0xe3dac0c99affef02 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841840.932371:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841840.932514:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695077504 00000100:00100000:2.0:1787841840.932528:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695077504 00000100:00100000:2.0:1787841840.932599:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 57 00000100:00100000:2.0:1787841840.932611:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac30e4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b2767a54-6703-4908-8414-eab6601e2ceb+7:2356:x1874687695077504:12345-192.168.201.1@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787841840.932963:0:6687:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1787841840.932967:0:6687:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1787841841 -> 1787841840 00002000:00010000:2.0:1787841840.932970:0:6687:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787841838 00002000:00010000:2.0:1787841840.932972:0:6687:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1787841841 -> 1787841840 00002000:00010000:2.0:1787841840.932994:0:6687:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1787841840.933091:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac30e4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b2767a54-6703-4908-8414-eab6601e2ceb+8:2356:x1874687695077504:12345-192.168.201.1@tcp:2:lhsmtool_posix.0 Request processed in 473us (727us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1787841840.933101:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 57 00000100:00100000:0.0:1787841840.935795:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841840.936178:0:12018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695077760 00000100:00100000:1.0:1787841840.936204:0:12018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695077760 00000100:00100000:1.0:1787841840.936343:0:12018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 185 00000100:00100000:1.0:1787841840.936356:0:12018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac2dbe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b2767a54-6703-4908-8414-eab6601e2ceb+18:11520:x1874687695077760:12345-192.168.201.1@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787841840.936462:0:12018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99affef09 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841840.936485:0:12018:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affeeca lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a74 expref: 18 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841840.936496:0:12018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99affef09 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841840.936548:0:12018:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affeeca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a74 expref: 18 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841840.936564:0:12018:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affeeca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a74 expref: 18 pid: 12018 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841840.936583:0:12018:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac30e5680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12018:1874687714997248:192.168.201.1@tcp:104: 00000100:00100000:1.0:1787841840.936770:0:12018:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc2e21000 going to sleep for 11 seconds 00000100:00100000:1.0:1787841840.939414:0:12018:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac30e5680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12018:1874687714997248:192.168.201.1@tcp:104: 00010000:00010000:1.0:1787841840.939458:0:12018:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99affef09 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841840.940217:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841840.940665:0:7633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695077888 00000100:00100000:1.0:1787841840.940676:0:7633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695077888 00010000:00010000:1.0:1787841840.940783:0:7633:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affeeca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a74 expref: 19 pid: 12018 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841840.940843:0:7633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 69 00000100:00100000:1.0:1787841840.940854:0:7633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcdb7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b2767a54-6703-4908-8414-eab6601e2ceb+19:2356:x1874687695077888:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787841840.940888:0:7633:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787841840.940898:0:7633:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affeeca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a74 expref: 19 pid: 12018 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841840.940916:0:7633:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affeeca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a74 expref: 19 pid: 12018 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841840.940954:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affeeca lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a74 expref: 19 pid: 12018 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841840.940978:0:7633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff92cbc89cd700) 00010000:00010000:1.0:1787841840.940985:0:7633:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99affef09 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841840.940997:0:7633:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99affef09 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841840.941035:0:7633:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99affef09 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841840.941075:0:7633:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787841840.941167:0:7633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcdb7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b2767a54-6703-4908-8414-eab6601e2ceb+18:2356:x1874687695077888:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 313us (952us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841840.941176:0:7633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 69 00010000:00010000:3.0:1787841840.941207:0:12018:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99affef09 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841840.941217:0:12018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99affef09 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841840.941260:0:12018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99affef09 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841840.941267:0:12018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99affef09 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841840.941274:0:12018:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99affef09 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841840.941280:0:12018:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cc00d9d400 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:3.0:1787841840.941285:0:12018:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99affef09 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841840.941294:0:12018:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99affef09 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841840.941304:0:12018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff92cbc89cd700) 00010000:00010000:3.0:1787841840.941308:0:12018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787841840.941312:0:12018:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99affef09 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841840.941327:0:12018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99affef09 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841840.941396:0:12018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac2dbe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b2767a54-6703-4908-8414-eab6601e2ceb+17:11520:x1874687695077760:12345-192.168.201.1@tcp:55:lhsmtool_posix.0 Request processed in 5043us (5617us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787841840.941405:0:12018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 185 00000100:00100000:0.0:1787841840.945032:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841840.945223:0:12388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695078016 00000100:00100000:3.0:1787841840.945237:0:12388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695078016 00000100:00100000:3.0:1787841840.945377:0:12388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 58 00000100:00100000:3.0:1787841840.945389:0:12388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac2dbc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b2767a54-6703-4908-8414-eab6601e2ceb+8:2354:x1874687695078016:12345-192.168.201.1@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787841840.945462:0:12388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c95fddcb/0xe3dac0c99affef10 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841840.945489:0:12388:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000022a2dbdf/0xe3dac0c99affeef4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a90 expref: 8 pid: 9572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841840.945499:0:12388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787841840.945505:0:12388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787841840.945510:0:12388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c95fddcb/0xe3dac0c99affef10 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841840.945557:0:12388:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000022a2dbdf/0xe3dac0c99affeef4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a90 expref: 8 pid: 9572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841840.945574:0:12388:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000022a2dbdf/0xe3dac0c99affeef4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a90 expref: 8 pid: 9572 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841840.945619:0:12388:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac1117840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12388:1874687714997376:192.168.201.1@tcp:104: 00000100:00100000:3.0:1787841840.945766:0:12388:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc6722cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787841840.950566:0:12388:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac1117840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12388:1874687714997376:192.168.201.1@tcp:104: 00010000:00010000:3.0:1787841840.950611:0:12388:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c95fddcb/0xe3dac0c99affef10 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841840.951182:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841840.951423:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695078144 00000100:00100000:1.0:1787841840.951433:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695078144 00010000:00010000:1.0:1787841840.951487:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000022a2dbdf/0xe3dac0c99affeef4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a90 expref: 9 pid: 9572 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841840.951534:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 70 00000100:00100000:1.0:1787841840.951544:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac2dbed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b2767a54-6703-4908-8414-eab6601e2ceb+9:2357:x1874687695078144:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787841840.951569:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787841840.951604:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000022a2dbdf/0xe3dac0c99affeef4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a90 expref: 9 pid: 9572 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841840.951621:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000022a2dbdf/0xe3dac0c99affeef4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a90 expref: 9 pid: 9572 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841840.951652:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022a2dbdf/0xe3dac0c99affeef4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a90 expref: 9 pid: 9572 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841840.951678:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787841840.951684:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787841840.951755:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c95fddcb/0xe3dac0c99affef10 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841840.951767:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c95fddcb/0xe3dac0c99affef10 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841840.951802:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787841840.951884:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac2dbed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b2767a54-6703-4908-8414-eab6601e2ceb+8:2357:x1874687695078144:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 341us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841840.951892:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 70 00010000:00010000:0.0:1787841840.953104:0:12388:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c95fddcb/0xe3dac0c99affef10 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841840.953134:0:12388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c95fddcb/0xe3dac0c99affef10 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841840.953176:0:12388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c95fddcb/0xe3dac0c99affef10 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841840.953185:0:12388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c95fddcb/0xe3dac0c99affef10 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841840.953195:0:12388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c95fddcb/0xe3dac0c99affef10 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841840.953203:0:12388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc149de00 already unused, calling callback (ffffffffc17a4500) 00010000:00010000:0.0:1787841840.953207:0:12388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c95fddcb/0xe3dac0c99affef10 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841840.953218:0:12388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c95fddcb/0xe3dac0c99affef10 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841840.953237:0:12388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c95fddcb/0xe3dac0c99affef10 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841840.953262:0:12388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c95fddcb/0xe3dac0c99affef10 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841840.953384:0:12388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac2dbc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b2767a54-6703-4908-8414-eab6601e2ceb+7:2354:x1874687695078016:12345-192.168.201.1@tcp:1:lhsmtool_posix.0 Request processed in 7992us (8364us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841840.953396:0:12388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 58 00000100:00100000:0.0:1787841840.957205:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841840.961659:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695078400 00000100:00100000:1.0:1787841840.961689:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695078400 00000100:00100000:1.0:1787841840.961804:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 186 00000100:00100000:1.0:1787841840.961816:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac2dbd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+17:11520:x1874687695078400:12345-192.168.201.1@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787841840.961941:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d800/0xe3dac0c99affef17 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841840.961964:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d800/0xe3dac0c99affef17 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841840.961979:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d800/0xe3dac0c99affef17 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841840.962283:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c400/0xe3dac0c99affef1e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841840.962297:0:9449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affeed8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a7b expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841840.962305:0:9449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c400/0xe3dac0c99affef1e lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841840.962381:0:9449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affeed8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a7b expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841840.962398:0:9449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affeed8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a7b expref: 18 pid: 5839 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841840.962423:0:9449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac30e6d00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9449:1874687714997504:192.168.201.1@tcp:104: 00000100:00100000:1.0:1787841840.962553:0:9449:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc2e21e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787841840.965854:0:9449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac30e6d00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9449:1874687714997504:192.168.201.1@tcp:104: 00010000:00010000:1.0:1787841840.965907:0:9449:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c400/0xe3dac0c99affef1e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841840.967074:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841840.967262:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695078528 00000100:00100000:1.0:1787841840.967276:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695078528 00010000:00010000:1.0:1787841840.967345:0:7632:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affeed8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a7b expref: 19 pid: 5839 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841840.967466:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 71 00000100:00100000:1.0:1787841840.967479:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac1117840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b2767a54-6703-4908-8414-eab6601e2ceb+19:2357:x1874687695078528:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787841840.967502:0:7632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787841840.967511:0:7632:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affeed8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a7b expref: 19 pid: 5839 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841840.967529:0:7632:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affeed8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a7b expref: 19 pid: 5839 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841840.967600:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affeed8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a7b expref: 19 pid: 5839 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841840.967627:0:7632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff92cbc89cd700) 00010000:00010000:1.0:1787841840.967634:0:7632:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c400/0xe3dac0c99affef1e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841840.967647:0:7632:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c400/0xe3dac0c99affef1e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841840.967657:0:7632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c400/0xe3dac0c99affef1e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841840.967718:0:7632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787841840.967806:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac1117840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b2767a54-6703-4908-8414-eab6601e2ceb+18:2357:x1874687695078528:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 329us (741us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841840.967816:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 71 00010000:00010000:3.0:1787841840.967888:0:9449:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c400/0xe3dac0c99affef1e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841840.967898:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c400/0xe3dac0c99affef1e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787841840.968242:0:9449:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:3.0:1787841840.968466:0:9449:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:3.0:1787841840.968517:0:9449:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:3.0:1787841840.968624:0:9449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac1115e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9449:1874687714997632:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787841840.968735:0:9449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841840.968786:0:9449:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc6722a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787841840.969166:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714997632 00000100:00100000:0.0:1787841840.969175:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714997632 00000100:00100000:0.0:1787841840.969241:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787841840.969251:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac1114000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:9449:x1874687714997632:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787841840.969366:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac1114000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:9449:x1874687714997632:12345-0@lo:1000:mdt00_003.0 Request processed in 116us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841840.969375:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787841840.970324:0:9449:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:3.0:1787841840.970341:0:9449:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff92cac1114f00, transno 4294967315 00000100:00100000:3.0:1787841840.970366:0:9449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac1115e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9449:1874687714997632:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1787841840.971186:0:9449:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:3.0:1787841840.971304:0:9449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac1115e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9449:1874687714997760:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787841840.971547:0:9449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841840.971603:0:9449:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc6722cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787841840.972518:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714997760 00000100:00100000:2.0:1787841840.972530:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714997760 00000100:00100000:2.0:1787841840.972602:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787841840.972614:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac11170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:9449:x1874687714997760:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787841840.973286:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac11170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:9449:x1874687714997760:12345-0@lo:1000:mdt00_003.0 Request processed in 673us (1881us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1787841840.973297:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787841840.973617:0:9449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac1115e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9449:1874687714997760:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1787841840.973686:0:9449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c400/0xe3dac0c99affef1e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841840.975582:0:9449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c400/0xe3dac0c99affef1e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841840.975605:0:9449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c400/0xe3dac0c99affef1e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841840.975613:0:9449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cc00d9c400 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:3.0:1787841840.975619:0:9449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c400/0xe3dac0c99affef1e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841840.975630:0:9449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c400/0xe3dac0c99affef1e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841840.975651:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff92cbc89cd700) 00010000:00010000:3.0:1787841840.975654:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787841840.975660:0:9449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c400/0xe3dac0c99affef1e lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841840.975667:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c400/0xe3dac0c99affef1e lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841840.975737:0:9449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a800/0xe3dac0c99affee53 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841840.975745:0:9449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a800/0xe3dac0c99affee53 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841840.975751:0:9449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a800/0xe3dac0c99affee53 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841840.975766:0:9449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbffa3a800 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:3.0:1787841840.975769:0:9449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a800/0xe3dac0c99affee53 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841840.975776:0:9449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a800/0xe3dac0c99affee53 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841840.975785:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92cbc57e3f00) 00010000:00010000:3.0:1787841840.975788:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787841840.975791:0:9449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a800/0xe3dac0c99affee53 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841840.975798:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a800/0xe3dac0c99affee53 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841840.975823:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affef25 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841840.975842:0:9449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d000/0xe3dac0c99affee6f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a5f expref: 21 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841840.975851:0:9449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affef25 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841840.975901:0:9449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d000/0xe3dac0c99affee6f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a5f expref: 21 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841840.975920:0:9449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d000/0xe3dac0c99affee6f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a5f expref: 21 pid: 5839 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841840.975951:0:9449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac1116940 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9449:1874687714997888:192.168.201.1@tcp:104: 00000100:00100000:3.0:1787841840.976070:0:9449:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc6722cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787841840.981607:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841840.981686:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695078656 00000100:00100000:1.0:1787841840.981727:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695078656 00010000:00010000:1.0:1787841840.981782:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d000/0xe3dac0c99affee6f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a5f expref: 22 pid: 5839 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841840.981825:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 72 00000100:00100000:1.0:1787841840.981834:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac1114b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b2767a54-6703-4908-8414-eab6601e2ceb+22:2357:x1874687695078656:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787841840.981855:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787841840.981862:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d000/0xe3dac0c99affee6f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a5f expref: 22 pid: 5839 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841840.981911:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d000/0xe3dac0c99affee6f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a5f expref: 22 pid: 5839 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841840.981942:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92cbc57e3f00) 00010000:00010000:1.0:1787841840.981948:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affef25 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841840.981960:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affef25 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841840.981969:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affef25 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841840.981995:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787841840.982069:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac1114b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b2767a54-6703-4908-8414-eab6601e2ceb+22:2357:x1874687695078656:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 235us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841840.982077:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 72 00010000:00010000:0.0:1787841840.982599:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d000/0xe3dac0c99affee6f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a5f expref: 21 pid: 5839 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841840.982621:0:9449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac1116940 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9449:1874687714997888:192.168.201.1@tcp:104: 00010000:00010000:0.0:1787841840.982654:0:9449:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affef25 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841840.982665:0:9449:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affef25 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841840.982671:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affef25 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841840.982731:0:9449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affef25 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841840.982740:0:9449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affef25 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841840.982747:0:9449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affef25 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841840.982754:0:9449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc149d400 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:0.0:1787841840.982760:0:9449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affef25 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841840.982768:0:9449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affef25 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841840.982784:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92cbc57e3f00) 00010000:00010000:0.0:1787841840.982788:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841840.982792:0:9449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affef25 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841840.982798:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affef25 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841840.982811:0:9449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d800/0xe3dac0c99affef17 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841840.982818:0:9449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d800/0xe3dac0c99affef17 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841840.982824:0:9449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d800/0xe3dac0c99affef17 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841840.982836:0:9449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cc00d9d800 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:0.0:1787841840.982839:0:9449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d800/0xe3dac0c99affef17 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841840.982845:0:9449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d800/0xe3dac0c99affef17 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841840.982854:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92cbc57e3f00) 00010000:00010000:0.0:1787841840.982857:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787841840.982859:0:9449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d800/0xe3dac0c99affef17 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841840.982865:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d800/0xe3dac0c99affef17 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841840.983395:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac2dbd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+20:11520:x1874687695078400:12345-192.168.201.1@tcp:57:lhsmtool_posix.0 Request processed in 21577us (26201us total) trans 4294967466 rc 0/0 00000100:00100000:0.0:1787841840.983410:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 186 00000020:00080000:0.0:1787841840.983416:0:9449:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1787841840.985149:0:11682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787841840.985162:0:11682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787841840.985660:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:1.0:1787841840.985670:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787841840.994390:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841840.994542:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695078912 00000100:00100000:1.0:1787841840.994556:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695078912 00000100:00100000:1.0:1787841840.994630:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 50 00000100:00100000:1.0:1787841840.994642:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbc73ed450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b2767a54-6703-4908-8414-eab6601e2ceb+20:11520:x1874687695078912:12345-192.168.201.1@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1787841840.995557:0:5840:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787841840.995687:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:1.0:1787841840.995791:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affef2c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841840.995810:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affef2c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841840.995824:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affef2c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841840.995835:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affef2c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841840.995841:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affef2c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841840.995848:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affef2c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841840.995870:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787841840.995993:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbc73ed450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b2767a54-6703-4908-8414-eab6601e2ceb+22:11520:x1874687695078912:12345-192.168.201.1@tcp:35:lhsmtool_posix.0 Request processed in 1350us (1616us total) trans 4294967468 rc 0/0 00000100:00100000:1.0:1787841840.996005:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 50 00000020:00080000:1.0:1787841840.996012:0:5840:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787841840.996684:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787841840.996729:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affef2c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841840.996740:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cc00d9de00 already unused, calling callback (ffffffffc17a4500) 00010000:00010000:3.0:1787841840.996745:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affef2c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841840.996756:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affef2c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841840.996774:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff92cbd1fc7900) 00010000:00010000:3.0:1787841840.996778:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787841840.996784:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affef2c lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841840.996791:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affef2c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841840.996814:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841840.996816:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841840.996818:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787841841.220221:0:12416:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787841841.220234:0:12416:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787841841.220293:0:12416:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1787841841.220300:0:12416:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787841841.361945:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841841.362006:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695079168 00000100:00100000:1.0:1787841841.362019:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695079168 00000100:00080000:0.0:1787841841.362072:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787841841.362119:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 187 00000100:00100000:1.0:1787841841.362131:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac2dbc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+22:11530:x1874687695079168:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:1.0:1787841841.362159:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841841.362189:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affef33 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6a97 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841841.362556:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c600/0xe3dac0c99affef3a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841841.362574:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c600/0xe3dac0c99affef3a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841841.362591:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c600/0xe3dac0c99affef3a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787841841.362602:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:1.0:1787841841.362837:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affef33 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a97 expref: 25 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841841.362854:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c600/0xe3dac0c99affef3a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a97 expref: 24 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841841.362861:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92cbc57e3e00) 00010000:00010000:1.0:1787841841.362864:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787841841.362867:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cc00d9c600, rc 0) 00000100:00100000:1.0:1787841841.362939:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac2dbc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+24:11530:x1874687695079168:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 811us (1009us total) trans 4294967469 rc 0/0 00000100:00100000:1.0:1787841841.362947:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 187 00000100:00100000:1.0:1787841841.367576:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841841.367812:0:12018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695079296 00000100:00100000:3.0:1787841841.367827:0:12018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695079296 00000100:00100000:0.0:1787841841.367966:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 188 00000100:00100000:0.0:1787841841.367981:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac30e6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+24:11530:x1874687695079296:12345-192.168.201.1@tcp:34:lfs.0 00010000:00010000:0.0:1787841841.368085:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b000/0xe3dac0c99affef48 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841841.368120:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b000/0xe3dac0c99affef48 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841841.368136:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b000/0xe3dac0c99affef48 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841841.368157:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99affef4f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841841.368179:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99affef4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841841.368187:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99affef4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841841.368590:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a800/0xe3dac0c99affef56 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841841.368597:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a800/0xe3dac0c99affef56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841841.368603:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a800/0xe3dac0c99affef56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787841841.368650:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a800/0xe3dac0c99affef56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841841.368665:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b000/0xe3dac0c99affef48 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841841.368670:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b000/0xe3dac0c99affef48 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841841.368685:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b000/0xe3dac0c99affef48 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841841.368690:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbffa3b000 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:0.0:1787841841.368693:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b000/0xe3dac0c99affef48 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841841.368789:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b000/0xe3dac0c99affef48 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841841.368805:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92cbc57e3e00) 00010000:00010000:0.0:1787841841.368809:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841841.368815:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b000/0xe3dac0c99affef48 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841841.368822:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b000/0xe3dac0c99affef48 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841841.368834:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99affef4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841841.368840:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99affef4f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841841.368846:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99affef4f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841841.368851:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbffa3be00 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:0.0:1787841841.368854:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99affef4f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841841.368871:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99affef4f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841841.368879:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff92cbc57e3f00) 00010000:00010000:0.0:1787841841.368881:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841841.368885:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99affef4f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841841.368891:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99affef4f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841841.368907:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a800/0xe3dac0c99affef56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841841.368914:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a800/0xe3dac0c99affef56 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841841.368919:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a800/0xe3dac0c99affef56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841841.368924:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbffa3a800 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:0.0:1787841841.368927:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a800/0xe3dac0c99affef56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841841.368934:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a800/0xe3dac0c99affef56 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841841.368941:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92cbc57e3700) 00010000:00010000:0.0:1787841841.368945:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841841.368947:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a800/0xe3dac0c99affef56 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841841.368959:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a800/0xe3dac0c99affef56 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841841.369064:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac30e6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+24:11530:x1874687695079296:12345-192.168.201.1@tcp:34:lfs.0 Request processed in 1083us (1497us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841841.369076:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 188 00000100:00100000:0.0:1787841841.409193:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841841.409248:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695079552 00000100:00100000:0.0:1787841841.409260:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695079552 00000100:00100000:0.0:1787841841.409861:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 189 00000100:00100000:0.0:1787841841.409876:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac2dbd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+24:11533:x1874687695079552:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:0.0:1787841841.409906:0:9449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841841.409935:0:9449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a800/0xe3dac0c99affef5d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6a9e expref: -99 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841841.410043:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99affef64 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841841.410064:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99affef64 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841841.410079:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99affef64 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841841.410098:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b000/0xe3dac0c99affef6b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841841.410105:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b000/0xe3dac0c99affef6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841841.410132:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b000/0xe3dac0c99affef6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841841.410607:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3aa00/0xe3dac0c99affef72 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841841.410619:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3aa00/0xe3dac0c99affef72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841841.410629:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3aa00/0xe3dac0c99affef72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787841841.410641:0:9449:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1787841841.410823:0:9449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99affef64 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841841.410837:0:9449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99affef64 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841841.410853:0:9449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99affef64 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841841.410861:0:9449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbffa3be00 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:0.0:1787841841.410866:0:9449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99affef64 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841841.410875:0:9449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99affef64 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841841.410890:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92cbc57e3e00) 00010000:00010000:0.0:1787841841.410894:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841841.410907:0:9449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99affef64 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841841.410915:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99affef64 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841841.410929:0:9449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b000/0xe3dac0c99affef6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841841.410936:0:9449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b000/0xe3dac0c99affef6b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841841.410943:0:9449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b000/0xe3dac0c99affef6b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841841.410950:0:9449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbffa3b000 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:0.0:1787841841.410954:0:9449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b000/0xe3dac0c99affef6b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841841.410961:0:9449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b000/0xe3dac0c99affef6b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841841.410972:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff92cbc57e3700) 00010000:00010000:0.0:1787841841.410975:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841841.410978:0:9449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b000/0xe3dac0c99affef6b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841841.410984:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b000/0xe3dac0c99affef6b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841841.411050:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a800/0xe3dac0c99affef5d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a9e expref: 27 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841841.411083:0:9449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3aa00/0xe3dac0c99affef72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a9e expref: 26 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841841.411093:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92cbc57e3f00) 00010000:00010000:0.0:1787841841.411096:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787841841.411099:0:9449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbffa3aa00, rc 0) 00000100:00100000:0.0:1787841841.411200:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac2dbd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+26:11533:x1874687695079552:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 1326us (2022us total) trans 4294967470 rc 0/0 00000100:00100000:0.0:1787841841.411210:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 189 00000100:00100000:1.0:1787841841.412253:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac30e5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3301:1874687714998016:0@lo:400:kworker.0 00000100:00100000:1.0:1787841841.412347:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841841.412406:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac30e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1874687714998528:0@lo:400:kworker.0 00000100:00100000:1.0:1787841841.412435:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841841.412459:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714998016 00000100:00100000:3.0:1787841841.412475:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714998016 00000100:00100000:1.0:1787841841.412480:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787841841.412489:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac30e4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874687714998400:0@lo:400:kworker.0 00000100:00100000:1.0:1787841841.412523:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841841.412534:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1787841841.412546:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:3301:x1874687714998016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841841.412563:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac30e5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874687714998144:0@lo:400:kworker.0 00000100:00100000:1.0:1787841841.412599:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841841.412615:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:3301:x1874687714998016:12345-0@lo:400:kworker.0 Request processed in 71us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841841.412620:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac30e7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687714998656:0@lo:400:kworker.0 00000100:00100000:3.0:1787841841.412629:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:1.0:1787841841.412638:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841841.412655:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787841841.412661:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac30e61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1874687714998272:0@lo:400:kworker.0 00000100:00100000:1.0:1787841841.412678:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841841.412832:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714998528 00000100:00100000:1.0:1787841841.412835:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714998528 00000100:00100000:1.0:1787841841.412869:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714998144 00000100:00100000:1.0:1787841841.412871:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714998144 00000100:00100000:1.0:1787841841.412880:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714998272 00000100:00100000:1.0:1787841841.412881:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714998272 00000100:00100000:1.0:1787841841.412892:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1787841841.412896:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac30e5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874687714998528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841841.412922:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac30e5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874687714998528:12345-0@lo:400:kworker.0 Request processed in 27us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841841.412928:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1787841841.412942:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1787841841.412947:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac30e70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874687714998144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787841841.412972:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1787841841.412972:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac30e70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874687714998144:12345-0@lo:400:kworker.0 Request processed in 23us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841841.412981:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1787841841.412988:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac30e4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1874687714998272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841841.412999:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714998400 00000100:00100000:1.0:1787841841.413008:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714998400 00000100:00100000:1.0:1787841841.413033:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714998656 00000100:00100000:3.0:1787841841.413035:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac30e4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1874687714998272:12345-0@lo:400:kworker.0 Request processed in 50us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841841.413036:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714998656 00000100:00100000:3.0:1787841841.413046:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1787841841.413053:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787841841.413059:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac30e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3301:x1874687714998400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841841.413089:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac30e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3301:x1874687714998400:12345-0@lo:400:kworker.0 Request processed in 30us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841841.413094:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787841841.413108:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787841841.413112:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac30e6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3298:x1874687714998656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841841.413135:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac30e6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3298:x1874687714998656:12345-0@lo:400:kworker.0 Request processed in 23us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841841.413139:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787841841.413176:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac30e4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874687714998400:0@lo:400:kworker.0 00000100:00100000:1.0:1787841841.413190:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac30e5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3301:1874687714998016:0@lo:400:kworker.0 00000100:00100000:1.0:1787841841.413201:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac30e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1874687714998528:0@lo:400:kworker.0 00000100:00100000:1.0:1787841841.413240:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac30e61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1874687714998272:0@lo:400:kworker.0 00000100:00100000:1.0:1787841841.413249:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac30e5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874687714998144:0@lo:400:kworker.0 00000100:00100000:1.0:1787841841.413258:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac30e7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687714998656:0@lo:400:kworker.0 00000100:00080000:0.0:1787841841.414458:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787841841.414479:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac2dbda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874687714998784:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787841841.414551:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841841.414617:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714998784 00000100:00100000:3.0:1787841841.414625:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714998784 00000100:00100000:3.0:1787841841.414689:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787841841.414723:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac1116580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3299:x1874687714998784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787841841.414778:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787841841.414826:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac1116580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3299:x1874687714998784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 129us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841841.414832:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787841841.414880:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac2dbda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874687714998784:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787841841.416427:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841841.416554:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695079680 00000100:00100000:3.0:1787841841.416569:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695079680 00000100:00100000:3.0:1787841841.416636:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 190 00000100:00100000:3.0:1787841841.416648:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac2dbe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2767a54-6703-4908-8414-eab6601e2ceb+26:11533:x1874687695079680:12345-192.168.201.1@tcp:54:lfs.0 00010000:00010000:3.0:1787841841.417101:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affef80 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.417128:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affef80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.417144:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affef80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.417181:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affef80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.417190:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affef80 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.417197:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affef80 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.417204:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc149d400 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:3.0:1787841841.417209:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affef80 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.417219:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affef80 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.417235:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92cbc57e3f00) 00010000:00010000:3.0:1787841841.417239:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787841841.417245:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affef80 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.417252:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affef80 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841841.417489:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac2dbe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2767a54-6703-4908-8414-eab6601e2ceb+26:11533:x1874687695079680:12345-192.168.201.1@tcp:54:lfs.0 Request processed in 842us (1070us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841841.417499:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 190 00000100:00100000:0.0:1787841841.424018:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841841.424383:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695079936 00000100:00100000:2.0:1787841841.424396:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695079936 00000100:00100000:2.0:1787841841.424472:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 51 00000100:00100000:2.0:1787841841.424482:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac2dbcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b2767a54-6703-4908-8414-eab6601e2ceb+26:11533:x1874687695079936:12345-192.168.201.1@tcp:35:lfs.0 00000100:00100000:2.0:1787841841.424803:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac2dbcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b2767a54-6703-4908-8414-eab6601e2ceb+27:11533:x1874687695079936:12345-192.168.201.1@tcp:35:lfs.0 Request processed in 320us (802us total) trans 4294967471 rc 0/0 00000100:00100000:2.0:1787841841.424811:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 51 00000100:00100000:0.0:1787841841.463861:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841841.465479:0:12018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695080192 00000100:00100000:1.0:1787841841.465501:0:12018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695080192 00000100:00100000:1.0:1787841841.465599:0:12018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 191 00000100:00100000:1.0:1787841841.465613:0:12018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac2dbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b2767a54-6703-4908-8414-eab6601e2ceb+27:11067:x1874687695080192:12345-192.168.201.1@tcp:101:bash.0 00010000:00010000:1.0:1787841841.465652:0:12018:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841841.465717:0:12018:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9da00/0xe3dac0c99affef87 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6aa5 expref: -99 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841841.465859:0:12018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affef8e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841841.465879:0:12018:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3aa00/0xe3dac0c99affef72 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a9e expref: 28 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841841.465889:0:12018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affef8e lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841841.465934:0:12018:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3aa00/0xe3dac0c99affef72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a9e expref: 28 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841841.465950:0:12018:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3aa00/0xe3dac0c99affef72 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a9e expref: 28 pid: 9449 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841841.465966:0:12018:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac30e7840 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12018:1874687714998912:192.168.201.1@tcp:104: 00000100:00100000:1.0:1787841841.466086:0:12018:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc2e21c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787841841.470487:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841841.470884:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695080320 00000100:00100000:3.0:1787841841.470898:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695080320 00010000:00010000:3.0:1787841841.470960:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3aa00/0xe3dac0c99affef72 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a9e expref: 29 pid: 9449 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841841.471020:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 73 00000100:00100000:3.0:1787841841.471030:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac2dbf840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b2767a54-6703-4908-8414-eab6601e2ceb+29:2356:x1874687695080320:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787841841.471054:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787841841.471063:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3aa00/0xe3dac0c99affef72 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a9e expref: 29 pid: 9449 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.471081:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3aa00/0xe3dac0c99affef72 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a9e expref: 29 pid: 9449 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.471125:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92cbc57e3f00) 00010000:00010000:3.0:1787841841.471137:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affef8e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.471151:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affef8e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.471162:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affef8e lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.471187:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787841841.471278:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac2dbf840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b2767a54-6703-4908-8414-eab6601e2ceb+29:2356:x1874687695080320:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 249us (808us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841841.471289:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 73 00010000:00010000:1.0:1787841841.473211:0:12018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3aa00/0xe3dac0c99affef72 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a9e expref: 28 pid: 9449 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841841.473243:0:12018:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac30e7840 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12018:1874687714998912:192.168.201.1@tcp:104: 00010000:00010000:1.0:1787841841.473275:0:12018:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affef8e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841841.473286:0:12018:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affef8e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841841.473544:0:12018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affef8e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787841841.473573:0:12018:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1787841841.473996:0:12018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9da00/0xe3dac0c99affef87 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6aa5 expref: 29 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841841.474018:0:12018:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affef8e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6aa5 expref: 28 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841841.474028:0:12018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92cbc57e3f00) 00010000:00010000:1.0:1787841841.474032:0:12018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787841841.474037:0:12018:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cc00d9d600, rc 0) 00000100:00100000:1.0:1787841841.474161:0:12018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac2dbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b2767a54-6703-4908-8414-eab6601e2ceb+28:11067:x1874687695080192:12345-192.168.201.1@tcp:101:bash.0 Request processed in 8550us (10310us total) trans 4294967472 rc 0/0 00000100:00100000:1.0:1787841841.474172:0:12018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 191 00000100:00100000:0.0:1787841841.478360:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841841.479015:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695080576 00000100:00100000:2.0:1787841841.479029:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695080576 00000100:00100000:2.0:1787841841.479135:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 192 00000100:00100000:2.0:1787841841.479145:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac2dbde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+28:11067:x1874687695080576:12345-192.168.201.1@tcp:36:bash.0 00010000:00010000:2.0:1787841841.479529:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105a00/0xe3dac0c99affef9c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841841.479549:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105a00/0xe3dac0c99affef9c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841841.479584:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105a00/0xe3dac0c99affef9c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787841841.479639:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:2.0:1787841841.479658:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b89ebe72 reply state 00000000d3f10826 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105a00/0xe3dac0c99affef9c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841841.479668:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1787841841.479755:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:2.0:1787841841.479862:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac2dbde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+32:11067:x1874687695080576:12345-192.168.201.1@tcp:36:bash.0 Request processed in 718us (1518us total) trans 4294967475 rc 0/0 00000100:00100000:2.0:1787841841.479877:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 192 00000020:00080000:2.0:1787841841.479882:0:5837:0:(tgt_main.c:785:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1787841841.483309:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105a00/0xe3dac0c99affef9c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.483556:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105a00/0xe3dac0c99affef9c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.483566:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105a00/0xe3dac0c99affef9c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.483573:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6105a00 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:3.0:1787841841.483641:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105a00/0xe3dac0c99affef9c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.483651:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105a00/0xe3dac0c99affef9c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.483686:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92cbc57e3f00) 00010000:00010000:3.0:1787841841.483690:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787841841.483718:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105a00/0xe3dac0c99affef9c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.483726:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105a00/0xe3dac0c99affef9c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841841.485226:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841841.485896:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695080704 00000100:00100000:3.0:1787841841.485909:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695080704 00000100:00100000:3.0:1787841841.485985:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 193 00000100:00100000:3.0:1787841841.485998:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac2dbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2767a54-6703-4908-8414-eab6601e2ceb+31:11067:x1874687695080704:12345-192.168.201.1@tcp:101:bash.0 00010000:00010000:3.0:1787841841.486052:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841841.486081:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affefa3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6aac expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.486166:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affefa3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6aac expref: 32 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.486183:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affefa3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6aac expref: 32 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.486205:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92cbc57e3f00) 00010000:00010000:3.0:1787841841.486209:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787841841.486214:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc149d400, rc 0) 00000100:00100000:3.0:1787841841.486312:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac2dbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2767a54-6703-4908-8414-eab6601e2ceb+32:11067:x1874687695080704:12345-192.168.201.1@tcp:101:bash.0 Request processed in 316us (1103us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841841.486329:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 193 00000100:00100000:2.0:1787841841.494054:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841841.494188:0:12388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695080832 00000100:00100000:0.0:1787841841.494201:0:12388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695080832 00000100:00100000:0.0:1787841841.494273:0:12388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 59 00000100:00100000:0.0:1787841841.494285:0:12388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6df6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b2767a54-6703-4908-8414-eab6601e2ceb+7:11067:x1874687695080832:12345-192.168.201.1@tcp:101:bash.0 00010000:00010000:0.0:1787841841.494333:0:12388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841841.494360:0:12388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000070798621/0xe3dac0c99affefaa lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6ab3 expref: -99 pid: 12388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787841841.494407:0:12388:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a904d30, atime: 0x6a904d2e, ctime: 0x6a904d30, blocks: 0xb 00010000:00010000:0.0:1787841841.494861:0:12388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=381s v=(0 0) 00010000:00010000:0.0:1787841841.494887:0:12388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787841841.494899:0:12388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000070798621/0xe3dac0c99affefaa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6ab3 expref: 8 pid: 12388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841841.494926:0:12388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000070798621/0xe3dac0c99affefaa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6ab3 expref: 8 pid: 12388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841841.494941:0:12388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbffa3bc00, rc 0) 00000100:00100000:0.0:1787841841.495033:0:12388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6df6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b2767a54-6703-4908-8414-eab6601e2ceb+8:11067:x1874687695080832:12345-192.168.201.1@tcp:101:bash.0 Request processed in 735us (981us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841841.495042:0:12388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 59 00000100:00100000:1.0:1787841841.501134:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841841.501211:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695080960 00000100:00100000:3.0:1787841841.501225:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695080960 00002000:00010000:3.0:1787841841.501396:0:6693:0:(ofd_dev.c:2831:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:3.0:1787841841.501402:0:6693:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff92cac30e7840 with x1874687695080960 ext(0->18446744073709551615) 00002000:00010000:3.0:1787841841.501418:0:6693:0:(ofd_dev.c:2836:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92cac30e7840. 00000100:00100000:3.0:1787841841.501472:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 5 00000100:00100000:3.0:1787841841.501484:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac30e7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b2767a54-6703-4908-8414-eab6601e2ceb+8:2356:x1874687695080960:12345-192.168.201.1@tcp:10:bash.0 00002000:00010000:3.0:1787841841.501990:0:6693:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1787841841.501995:0:6693:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1787841840 -> 1787841842 00002000:00010000:3.0:1787841841.501999:0:6693:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1787841838 -> 1787841838 00002000:00010000:3.0:1787841841.502021:0:6693:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1787841840 -> 1787841842 00002000:00010000:3.0:1787841841.502023:0:6693:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1787841841.503655:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac30e7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b2767a54-6703-4908-8414-eab6601e2ceb+9:2356:x1874687695080960:12345-192.168.201.1@tcp:10:bash.0 Request processed in 2153us (2519us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1787841841.503673:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 5 00002000:00010000:3.0:1787841841.503682:0:6693:0:(ofd_dev.c:2831:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:3.0:1787841841.503687:0:6693:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff92cac30e7840 with x1874687695080960 ext(0->18446744073709551615) 00002000:00010000:3.0:1787841841.503718:0:6693:0:(ofd_dev.c:2836:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92cac30e7840. 00000100:00100000:0.0:1787841841.581808:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841841.584603:0:12018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695081088 00000100:00100000:1.0:1787841841.584633:0:12018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695081088 00000100:00100000:1.0:1787841841.584785:0:12018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 194 00000100:00100000:1.0:1787841841.584800:0:12018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac2dbda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b2767a54-6703-4908-8414-eab6601e2ceb+32:11547:x1874687695081088:12345-192.168.201.1@tcp:34:lfs.0 00010000:00010000:1.0:1787841841.584927:0:12018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affefb1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841841.584954:0:12018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affefb1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841841.584970:0:12018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affefb1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841841.585014:0:12018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c400/0xe3dac0c99affefb8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841841.585023:0:12018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c400/0xe3dac0c99affefb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841841.585031:0:12018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c400/0xe3dac0c99affefb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841841.590795:0:12018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d800/0xe3dac0c99affefbf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841841.590819:0:12018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d800/0xe3dac0c99affefbf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841841.590831:0:12018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d800/0xe3dac0c99affefbf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787841841.590892:0:12018:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d800/0xe3dac0c99affefbf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841841.590904:0:12018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affefb1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841841.590910:0:12018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affefb1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841841.590916:0:12018:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affefb1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841841.590919:0:12018:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cc00d9de00 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:1.0:1787841841.590923:0:12018:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affefb1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841841.590942:0:12018:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affefb1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841841.590954:0:12018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92cbc57e3e00) 00010000:00010000:1.0:1787841841.590956:0:12018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787841841.590961:0:12018:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affefb1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841841.590965:0:12018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99affefb1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841841.590978:0:12018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c400/0xe3dac0c99affefb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841841.590981:0:12018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c400/0xe3dac0c99affefb8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841841.590985:0:12018:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c400/0xe3dac0c99affefb8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841841.590988:0:12018:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cc00d9c400 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:1.0:1787841841.590990:0:12018:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c400/0xe3dac0c99affefb8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841841.590993:0:12018:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c400/0xe3dac0c99affefb8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841841.590997:0:12018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff92cbd1fc7700) 00010000:00010000:1.0:1787841841.590998:0:12018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787841841.591000:0:12018:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c400/0xe3dac0c99affefb8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841841.591011:0:12018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c400/0xe3dac0c99affefb8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841841.591026:0:12018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d800/0xe3dac0c99affefbf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841841.591029:0:12018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d800/0xe3dac0c99affefbf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841841.591034:0:12018:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d800/0xe3dac0c99affefbf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841841.591037:0:12018:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cc00d9d800 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:1.0:1787841841.591038:0:12018:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d800/0xe3dac0c99affefbf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841841.591041:0:12018:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d800/0xe3dac0c99affefbf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841841.591045:0:12018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92cbc57e3f00) 00010000:00010000:1.0:1787841841.591046:0:12018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787841841.591048:0:12018:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d800/0xe3dac0c99affefbf lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841841.591051:0:12018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d800/0xe3dac0c99affefbf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841841.591650:0:12018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac2dbda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b2767a54-6703-4908-8414-eab6601e2ceb+32:11547:x1874687695081088:12345-192.168.201.1@tcp:34:lfs.0 Request processed in 6844us (9853us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841841.591664:0:12018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 194 00000100:00100000:2.0:1787841841.661175:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841841.661469:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695081344 00000100:00100000:0.0:1787841841.661485:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695081344 00000100:00100000:0.0:1787841841.663064:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 195 00000100:00100000:0.0:1787841841.663085:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6df4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+32:11550:x1874687695081344:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:0.0:1787841841.663117:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841841.663151:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b400/0xe3dac0c99affefc6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6aba expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.663645:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affefcd lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.663663:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affefcd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.663675:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affefcd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.663688:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149de00/0xe3dac0c99affefd4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.663694:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149de00/0xe3dac0c99affefd4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.663715:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149de00/0xe3dac0c99affefd4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.664208:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affefdb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.664219:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affefdb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.664239:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affefdb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787841841.664250:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1787841841.664692:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affefcd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.664725:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affefcd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.664732:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affefcd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.664738:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc149c000 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:3.0:1787841841.664742:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affefcd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.664748:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affefcd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.664762:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92cbc57e3e00) 00010000:00010000:3.0:1787841841.664765:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787841841.664769:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affefcd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.664774:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affefcd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.664790:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149de00/0xe3dac0c99affefd4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.664794:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149de00/0xe3dac0c99affefd4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.664806:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149de00/0xe3dac0c99affefd4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.664810:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc149de00 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:3.0:1787841841.664812:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149de00/0xe3dac0c99affefd4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.664816:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149de00/0xe3dac0c99affefd4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.664821:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff92cbc89cd700) 00010000:00010000:3.0:1787841841.664823:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787841841.664825:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149de00/0xe3dac0c99affefd4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.664829:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149de00/0xe3dac0c99affefd4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.664882:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b400/0xe3dac0c99affefc6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6aba expref: 35 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.664899:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affefdb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6aba expref: 34 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.664908:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92cbc57e3f00) 00010000:00010000:3.0:1787841841.664910:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787841841.664913:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc149c400, rc 0) 00000100:00100000:3.0:1787841841.665025:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6df4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+34:11550:x1874687695081344:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 1945us (3868us total) trans 4294967476 rc 0/0 00000100:00100000:3.0:1787841841.665046:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 195 00000100:00100000:0.0:1787841841.669917:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841841.670204:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695081472 00000100:00100000:3.0:1787841841.670221:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695081472 00000100:00100000:3.0:1787841841.670354:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 196 00000100:00100000:3.0:1787841841.670374:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac2dbfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2767a54-6703-4908-8414-eab6601e2ceb+34:11550:x1874687695081472:12345-192.168.201.1@tcp:54:lfs.0 00010000:00010000:3.0:1787841841.670481:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affefe9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.670503:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affef8e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6aa5 expref: 34 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.670515:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affefe9 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.670562:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affef8e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6aa5 expref: 34 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.670579:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affef8e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6aa5 expref: 34 pid: 12018 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841841.670598:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac11143c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5838:1874687714999040:192.168.201.1@tcp:104: 00000100:00100000:3.0:1787841841.670787:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc6722900 going to sleep for 11 seconds 00000100:00100000:3.0:1787841841.674485:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac11143c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5838:1874687714999040:192.168.201.1@tcp:104: 00010000:00010000:3.0:1787841841.674532:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affefe9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841841.675757:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841841.675829:0:12373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695081728 00000100:00100000:2.0:1787841841.675841:0:12373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695081728 00000100:00100000:2.0:1787841841.675926:0:12373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 52 00000100:00100000:2.0:1787841841.675935:0:12373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cc00cc61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b2767a54-6703-4908-8414-eab6601e2ceb+35:5605:x1874687695081728:12345-192.168.201.1@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787841841.676347:0:12373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cc00cc61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b2767a54-6703-4908-8414-eab6601e2ceb+36:5605:x1874687695081728:12345-192.168.201.1@tcp:35:ldlm_bl.0 Request processed in 413us (605us total) trans 4294967477 rc 0/0 00000100:00100000:2.0:1787841841.676354:0:12373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 52 00000100:00100000:0.0:1787841841.683030:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841841.683100:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695081856 00000100:00100000:1.0:1787841841.683117:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695081856 00010000:00010000:1.0:1787841841.683187:0:7632:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affef8e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6aa5 expref: 36 pid: 12018 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841841.683251:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 74 00000100:00100000:1.0:1787841841.683264:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cc00cc4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b2767a54-6703-4908-8414-eab6601e2ceb+36:2357:x1874687695081856:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787841841.683285:0:7632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787841841.683293:0:7632:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affef8e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6aa5 expref: 36 pid: 12018 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841841.683309:0:7632:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affef8e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6aa5 expref: 36 pid: 12018 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841841.683357:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99affef8e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6aa5 expref: 36 pid: 12018 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841841.684087:0:7632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92cbc57e3f00) 00010000:00010000:1.0:1787841841.684094:0:7632:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affefe9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841841.684106:0:7632:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affefe9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841841.684115:0:7632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affefe9 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841841.684225:0:7632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787841841.684312:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cc00cc4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b2767a54-6703-4908-8414-eab6601e2ceb+35:2357:x1874687695081856:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 1048us (1302us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841841.684351:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 74 00010000:00010000:3.0:1787841841.684656:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affefe9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.684673:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affefe9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.684940:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affefe9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.684948:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affefe9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.684955:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affefe9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.684962:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc149d600 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:3.0:1787841841.684967:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affefe9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.684975:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affefe9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.684991:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92cbc57e3f00) 00010000:00010000:3.0:1787841841.684994:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787841841.684998:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affefe9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.685005:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affefe9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841841.685146:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac2dbfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2767a54-6703-4908-8414-eab6601e2ceb+34:11550:x1874687695081472:12345-192.168.201.1@tcp:54:lfs.0 Request processed in 14773us (15248us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841841.685158:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 196 00000100:00100000:1.0:1787841841.688491:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841841.688572:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695082112 00000100:00100000:3.0:1787841841.688584:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695082112 00000100:00100000:1.0:1787841841.688816:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 53 00000100:00100000:1.0:1787841841.688827:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac30e5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b2767a54-6703-4908-8414-eab6601e2ceb+34:11550:x1874687695082112:12345-192.168.201.1@tcp:35:lfs.0 00000100:00100000:1.0:1787841841.689259:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac30e5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b2767a54-6703-4908-8414-eab6601e2ceb+35:11550:x1874687695082112:12345-192.168.201.1@tcp:35:lfs.0 Request processed in 431us (777us total) trans 4294967478 rc 0/0 00000100:00100000:1.0:1787841841.689267:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 53 00010000:00010000:2.0:1787841841.730115:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787841841.814087:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841841.814208:0:12018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695082368 00000100:00100000:3.0:1787841841.814225:0:12018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695082368 00000100:00100000:3.0:1787841841.814333:0:12018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 197 00000100:00100000:3.0:1787841841.814347:0:12018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac30e61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b2767a54-6703-4908-8414-eab6601e2ceb+35:11561:x1874687695082368:12345-192.168.201.1@tcp:101:cat.0 00010000:00010000:3.0:1787841841.814528:0:12018:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841841.814562:0:12018:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affeff0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6ac1 expref: -99 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.814817:0:12018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149de00/0xe3dac0c99affeff7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.814838:0:12018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149de00/0xe3dac0c99affeff7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.814853:0:12018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149de00/0xe3dac0c99affeff7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.814871:0:12018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affeffe lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.814878:0:12018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affeffe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.814884:0:12018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affeffe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.815860:0:12018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169ba00/0xe3dac0c99afff005 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.815880:0:12018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169ba00/0xe3dac0c99afff005 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.815905:0:12018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169ba00/0xe3dac0c99afff005 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787841841.815921:0:12018:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:3.0:1787841841.816066:0:12018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149de00/0xe3dac0c99affeff7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.816074:0:12018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149de00/0xe3dac0c99affeff7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.816082:0:12018:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149de00/0xe3dac0c99affeff7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.816089:0:12018:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc149de00 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:3.0:1787841841.816094:0:12018:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149de00/0xe3dac0c99affeff7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.816104:0:12018:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149de00/0xe3dac0c99affeff7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.816122:0:12018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92cbc57e3e00) 00010000:00010000:3.0:1787841841.816125:0:12018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787841841.816132:0:12018:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149de00/0xe3dac0c99affeff7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.816139:0:12018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149de00/0xe3dac0c99affeff7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.816160:0:12018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affeffe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.816166:0:12018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affeffe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.816178:0:12018:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affeffe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.816185:0:12018:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc149c000 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:3.0:1787841841.816188:0:12018:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affeffe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.816195:0:12018:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affeffe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.816203:0:12018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff92cbc89cd700) 00010000:00010000:3.0:1787841841.816206:0:12018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787841841.816208:0:12018:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affeffe lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.816214:0:12018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99affeffe lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.818098:0:12018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99affeff0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6ac1 expref: 38 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.818139:0:12018:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169ba00/0xe3dac0c99afff005 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6ac1 expref: 37 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.818149:0:12018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92cbc57e3f00) 00010000:00010000:3.0:1787841841.818152:0:12018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787841841.818156:0:12018:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc169ba00, rc 0) 00000100:00100000:3.0:1787841841.818278:0:12018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac30e61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b2767a54-6703-4908-8414-eab6601e2ceb+37:11561:x1874687695082368:12345-192.168.201.1@tcp:101:cat.0 Request processed in 3932us (4208us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1787841841.818573:0:12018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 197 00000100:00100000:2.0:1787841841.843845:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841841.844003:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695082624 00000100:00100000:0.0:1787841841.844018:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695082624 00000100:00100000:0.0:1787841841.844089:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 54 00000100:00100000:0.0:1787841841.844107:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6df6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b2767a54-6703-4908-8414-eab6601e2ceb+37:11561:x1874687695082624:12345-192.168.201.1@tcp:35:cat.0 00000100:00100000:0.0:1787841841.844752:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6df6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b2767a54-6703-4908-8414-eab6601e2ceb+38:11561:x1874687695082624:12345-192.168.201.1@tcp:35:cat.0 Request processed in 643us (919us total) trans 4294967480 rc 0/0 00000100:00100000:0.0:1787841841.844761:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 54 00000100:00100000:1.0:1787841841.867003:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841841.867151:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695082880 00000100:00100000:3.0:1787841841.867171:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695082880 00000100:00100000:3.0:1787841841.867685:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 198 00000100:00100000:3.0:1787841841.867800:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac30e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+38:11562:x1874687695082880:12345-192.168.201.1@tcp:36:rm.0 00010000:00010000:3.0:1787841841.867915:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787841841.867960:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169ba00/0xe3dac0c99afff005 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6ac1 expref: 38 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.867986:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99affefdb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6aba expref: 37 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.868002:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99affefa3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6aac expref: 36 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.868016:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92cbc57e3f00) 00010000:00010000:3.0:1787841841.868032:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787841841.868370:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104c00/0xe3dac0c99afff013 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841841.868392:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104c00/0xe3dac0c99afff013 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841841.868426:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104c00/0xe3dac0c99afff013 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841841.868446:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104e00/0xe3dac0c99afff01a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841841.868454:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104e00/0xe3dac0c99afff01a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841841.868461:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104e00/0xe3dac0c99afff01a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841841.869023:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105a00/0xe3dac0c99afff021 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841841.869034:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105a00/0xe3dac0c99afff021 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841841.869041:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105a00/0xe3dac0c99afff021 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787841841.869798:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:2.0:1787841841.869811:0:5837:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 381868112508ns, next at 382868108689ns, rc = 0 00010000:00010000:2.0:1787841841.871249:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105200/0xe3dac0c99afff028 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841841.871275:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105200/0xe3dac0c99afff028 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841841.871289:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105200/0xe3dac0c99afff028 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841841.871326:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105200/0xe3dac0c99afff028 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841841.871334:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105200/0xe3dac0c99afff028 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841841.871341:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105200/0xe3dac0c99afff028 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841841.871369:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787841841.871402:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105a00/0xe3dac0c99afff021 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841841.871408:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105a00/0xe3dac0c99afff021 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841841.871413:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105a00/0xe3dac0c99afff021 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841841.871420:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6105a00 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:2.0:1787841841.871425:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105a00/0xe3dac0c99afff021 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841841.871433:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105a00/0xe3dac0c99afff021 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841841.871449:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92cbc3b04000) 00010000:00010000:2.0:1787841841.871452:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787841841.871459:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105a00/0xe3dac0c99afff021 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841841.871478:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105a00/0xe3dac0c99afff021 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841841.871508:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104c00/0xe3dac0c99afff013 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841841.871515:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104c00/0xe3dac0c99afff013 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841841.871520:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104c00/0xe3dac0c99afff013 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841841.871526:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6104c00 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:2.0:1787841841.871529:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104c00/0xe3dac0c99afff013 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841841.871536:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104c00/0xe3dac0c99afff013 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841841.871544:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92cbc57e3e00) 00010000:00010000:2.0:1787841841.871546:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787841841.871549:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104c00/0xe3dac0c99afff013 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841841.871555:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104c00/0xe3dac0c99afff013 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787841841.871566:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009c1ba2af reply state 00000000dd6cc107 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104e00/0xe3dac0c99afff01a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841841.871576:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787841841.871794:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787841841.871803:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105200/0xe3dac0c99afff028 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.871810:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6105200 already unused, calling callback (ffffffffc17a4500) 00010000:00010000:3.0:1787841841.871814:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105200/0xe3dac0c99afff028 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.871821:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105200/0xe3dac0c99afff028 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.871842:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92cbc3b04000) 00010000:00010000:3.0:1787841841.871844:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787841841.871847:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105200/0xe3dac0c99afff028 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.871853:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105200/0xe3dac0c99afff028 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.871880:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841841.871883:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841841.871884:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787841841.871966:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac30e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+37:11562:x1874687695082880:12345-192.168.201.1@tcp:36:rm.0 Request processed in 4259us (4975us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1787841841.871977:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 198 00010000:00010000:0.0:1787841841.884441:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104e00/0xe3dac0c99afff01a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841841.884471:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104e00/0xe3dac0c99afff01a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841841.884481:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104e00/0xe3dac0c99afff01a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841841.884488:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6104e00 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:0.0:1787841841.884495:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104e00/0xe3dac0c99afff01a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841841.884505:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104e00/0xe3dac0c99afff01a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841841.884529:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff92cbc3b04d00) 00010000:00010000:0.0:1787841841.884532:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841841.884539:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104e00/0xe3dac0c99afff01a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841841.884547:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104e00/0xe3dac0c99afff01a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841841.929814:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841841.929967:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695083136 00000100:00100000:3.0:1787841841.929984:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695083136 00000100:00100000:3.0:1787841841.930209:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 199 00000100:00100000:3.0:1787841841.930223:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac30e5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2767a54-6703-4908-8414-eab6601e2ceb+36:11568:x1874687695083136:12345-192.168.201.1@tcp:101:bash.0 00010000:00010000:3.0:1787841841.930261:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841841.930291:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169ba00/0xe3dac0c99afff02f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6ac8 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.930525:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169ac00/0xe3dac0c99afff036 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.930548:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169ac00/0xe3dac0c99afff036 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.930565:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169ac00/0xe3dac0c99afff036 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.930587:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169b600/0xe3dac0c99afff03d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.930623:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169b600/0xe3dac0c99afff03d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.930632:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169b600/0xe3dac0c99afff03d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787841841.940733:0:5838:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:0.0:1787841841.942534:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a200/0xe3dac0c99afff044 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841841.942589:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a200/0xe3dac0c99afff044 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841841.942605:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a200/0xe3dac0c99afff044 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841841.942680:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169ac00/0xe3dac0c99afff036 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841841.942688:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169ac00/0xe3dac0c99afff036 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841841.942713:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169ac00/0xe3dac0c99afff036 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841841.942721:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc169ac00 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:0.0:1787841841.942727:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169ac00/0xe3dac0c99afff036 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841841.942737:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169ac00/0xe3dac0c99afff036 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841841.942753:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92cbc57e3e00) 00010000:00010000:0.0:1787841841.942757:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841841.942764:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169ac00/0xe3dac0c99afff036 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841841.942771:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169ac00/0xe3dac0c99afff036 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787841841.942792:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009fc88b85 reply state 00000000ab509c28 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169b600/0xe3dac0c99afff03d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841841.942808:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787841841.942866:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169ba00/0xe3dac0c99afff02f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6ac8 expref: 39 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841841.942887:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a200/0xe3dac0c99afff044 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6ac8 expref: 38 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841841.942895:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92cbc57e3900) 00010000:00010000:0.0:1787841841.942897:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787841841.942900:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbffa3a200, rc 0) 00000100:00100000:0.0:1787841841.943151:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac30e5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2767a54-6703-4908-8414-eab6601e2ceb+39:11568:x1874687695083136:12345-192.168.201.1@tcp:101:bash.0 Request processed in 12871us (13296us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1787841841.943163:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 199 00010000:00010000:3.0:1787841841.956257:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169b600/0xe3dac0c99afff03d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.956290:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169b600/0xe3dac0c99afff03d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.956327:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169b600/0xe3dac0c99afff03d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.956340:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc169b600 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:3.0:1787841841.956350:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169b600/0xe3dac0c99afff03d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.956366:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169b600/0xe3dac0c99afff03d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.956528:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff92cbc89cd700) 00010000:00010000:3.0:1787841841.956533:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787841841.956540:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169b600/0xe3dac0c99afff03d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841841.956548:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169b600/0xe3dac0c99afff03d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841841.958556:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841841.958672:0:9572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695083264 00000100:00100000:3.0:1787841841.962693:0:9572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695083264 00000100:00100000:2.0:1787841841.963254:0:9572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 60 00000100:00100000:2.0:1787841841.963275:0:9572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac30e4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b2767a54-6703-4908-8414-eab6601e2ceb+5:2357:x1874687695083264:12345-192.168.201.1@tcp:101:bash.0 00010000:00010000:2.0:1787841841.963310:0:9572:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841841.963354:0:9572:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fa7ffe30/0xe3dac0c99afff052 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6acf expref: -99 pid: 9572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787841841.963407:0:9572:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787841841.963446:0:9572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=381s v=(0 0) 00010000:00010000:2.0:1787841841.963452:0:9572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787841841.963466:0:9572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa7ffe30/0xe3dac0c99afff052 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6acf expref: 6 pid: 9572 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841841.963502:0:9572:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fa7ffe30/0xe3dac0c99afff052 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6acf expref: 6 pid: 9572 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841841.963521:0:9572:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc6105a00, rc 0) 00000100:00100000:2.0:1787841841.963640:0:9572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac30e4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b2767a54-6703-4908-8414-eab6601e2ceb+6:2357:x1874687695083264:12345-192.168.201.1@tcp:101:bash.0 Request processed in 373us (5103us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841841.963649:0:9572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 60 00000100:00080000:0.0:1787841841.965056:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787841841.967220:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841841.967520:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695083392 00000100:00100000:2.0:1787841841.967533:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695083392 00000100:00100000:2.0:1787841841.967611:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 61 00000100:00100000:2.0:1787841841.967624:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac30e6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b2767a54-6703-4908-8414-eab6601e2ceb+6:11568:x1874687695083392:12345-192.168.201.1@tcp:101:bash.0 00010000:00010000:2.0:1787841841.967679:0:6686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841841.967772:0:6686:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ac7d004/0xe3dac0c99afff059 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6ad6 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841841.967822:0:6686:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fa7ffe30/0xe3dac0c99afff052 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6acf expref: 7 pid: 9572 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841841.967833:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787841841.967838:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787841841.967844:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ac7d004/0xe3dac0c99afff059 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6ad6 expref: 7 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841841.967889:0:6686:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fa7ffe30/0xe3dac0c99afff052 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6acf expref: 7 pid: 9572 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841841.967905:0:6686:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fa7ffe30/0xe3dac0c99afff052 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6acf expref: 7 pid: 9572 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841841.967923:0:6686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6df43c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6686:1874687714999168:192.168.201.1@tcp:104: 00000100:00100000:2.0:1787841841.968551:0:6686:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc6555240 going to sleep for 11 seconds 00000100:00100000:1.0:1787841841.971992:0:6686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6df43c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6686:1874687714999168:192.168.201.1@tcp:104: 00010000:00010000:1.0:1787841841.972048:0:6686:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008ac7d004/0xe3dac0c99afff059 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6ad6 expref: 7 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841841.972086:0:6686:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc6104a00, rc 0) 00000100:00100000:1.0:1787841841.974119:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac30e6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b2767a54-6703-4908-8414-eab6601e2ceb+7:11568:x1874687695083392:12345-192.168.201.1@tcp:101:bash.0 Request processed in 6479us (6895us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841841.974138:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 61 00000100:00100000:0.0:1787841841.976530:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841841.976650:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695083520 00000100:00100000:3.0:1787841841.976668:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695083520 00010000:00010000:0.0:1787841841.977298:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fa7ffe30/0xe3dac0c99afff052 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6acf expref: 7 pid: 9572 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841841.977415:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 75 00000100:00100000:0.0:1787841841.977431:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cc00cc7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b2767a54-6703-4908-8414-eab6601e2ceb+7:2357:x1874687695083520:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787841841.977453:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787841841.977483:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fa7ffe30/0xe3dac0c99afff052 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6acf expref: 7 pid: 9572 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841841.977499:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fa7ffe30/0xe3dac0c99afff052 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6acf expref: 7 pid: 9572 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841841.977549:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fa7ffe30/0xe3dac0c99afff052 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6acf expref: 7 pid: 9572 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841841.977577:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787841841.977583:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787841841.977593:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008ac7d004/0xe3dac0c99afff059 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6ad6 expref: 6 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841841.977607:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ac7d004/0xe3dac0c99afff059 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6ad6 expref: 6 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841841.977672:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008ac7d004/0xe3dac0c99afff059 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6ad6 expref: 6 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841841.977693:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cc00cc7840 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5825:1874687714999296:192.168.201.1@tcp:105: 00000100:00100000:0.0:1787841841.977884:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbd1ff9600 going to sleep for 11 seconds 00000100:00100000:2.0:1787841841.983254:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841841.983337:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695083776 00000100:00100000:1.0:1787841841.983349:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695083776 00000100:00100000:1.0:1787841841.983427:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 55 00000100:00100000:1.0:1787841841.983439:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6df6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b2767a54-6703-4908-8414-eab6601e2ceb+38:11568:x1874687695083776:12345-192.168.201.1@tcp:35:bash.0 00000100:00100000:1.0:1787841841.984587:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6df6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b2767a54-6703-4908-8414-eab6601e2ceb+39:11568:x1874687695083776:12345-192.168.201.1@tcp:35:bash.0 Request processed in 1141us (1339us total) trans 4294967483 rc 0/0 00000100:00100000:1.0:1787841841.984601:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 55 00000100:00100000:0.0:1787841841.984776:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cc00cc7840 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5825:1874687714999296:192.168.201.1@tcp:105: 00010000:00010000:0.0:1787841841.984812:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787841841.984922:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cc00cc7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b2767a54-6703-4908-8414-eab6601e2ceb+6:2357:x1874687695083520:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 7497us (8411us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841841.984943:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 75 00000100:00100000:1.0:1787841842.143381:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841842.143749:0:12018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695083904 00000100:00100000:3.0:1787841842.143765:0:12018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695083904 00000100:00100000:3.0:1787841842.143861:0:12018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 200 00000100:00100000:3.0:1787841842.143885:0:12018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac30e43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b2767a54-6703-4908-8414-eab6601e2ceb+39:11584:x1874687695083904:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:3.0:1787841842.143940:0:12018:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841842.143979:0:12018:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169b600/0xe3dac0c99afff060 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6add expref: -99 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841842.144084:0:12018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169ba00/0xe3dac0c99afff067 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841842.144114:0:12018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169ba00/0xe3dac0c99afff067 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841842.144131:0:12018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169ba00/0xe3dac0c99afff067 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787841842.144218:0:12018:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:3.0:1787841842.144222:0:12018:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787841842.144251:0:12018:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169ba00/0xe3dac0c99afff067 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841842.144282:0:12018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169b600/0xe3dac0c99afff060 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6add expref: 41 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841842.144303:0:12018:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169ba00/0xe3dac0c99afff067 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6add expref: 40 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841842.144347:0:12018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92cbc57e3e00) 00010000:00010000:3.0:1787841842.144351:0:12018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787841842.144357:0:12018:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc169ba00, rc 0) 00000100:00100000:3.0:1787841842.144462:0:12018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac30e43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b2767a54-6703-4908-8414-eab6601e2ceb+40:11584:x1874687695083904:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 591us (1100us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841842.144470:0:12018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 200 00000100:00100000:1.0:1787841842.150241:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841842.150427:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695084160 00000100:00100000:2.0:1787841842.150446:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695084160 00000100:00100000:2.0:1787841842.150569:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 201 00000100:00100000:2.0:1787841842.150585:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd7a4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+40:11584:x1874687695084160:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:2.0:1787841842.150624:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841842.150687:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104000/0xe3dac0c99afff06e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6ae4 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841842.150916:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105400/0xe3dac0c99afff075 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841842.151204:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105400/0xe3dac0c99afff075 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841842.151226:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105400/0xe3dac0c99afff075 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787841842.151246:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1787841842.151627:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104000/0xe3dac0c99afff06e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6ae4 expref: 43 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841842.151656:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105400/0xe3dac0c99afff075 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6ae4 expref: 42 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841842.151667:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92cbc57e3900) 00010000:00010000:2.0:1787841842.151671:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787841842.151677:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc6105400, rc 0) 00000100:00100000:2.0:1787841842.151872:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd7a4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+42:11584:x1874687695084160:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 1291us (1654us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1787841842.151884:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 201 00000100:00100000:2.0:1787841842.156396:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841842.156583:0:7633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695084544 00000100:00100000:1.0:1787841842.156597:0:7633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695084544 00000100:00100000:1.0:1787841842.156687:0:7633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 14 00000100:00100000:1.0:1787841842.156729:0:7633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcdb7a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b2767a54-6703-4908-8414-eab6601e2ceb+42:2357:x1874687695084544:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787841842.156754:0:7633:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787841842.156787:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105400/0xe3dac0c99afff075 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6ae4 expref: 42 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841842.156809:0:7633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92cbc57e3900) 00010000:00010000:1.0:1787841842.156815:0:7633:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787841842.156956:0:7633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcdb7a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b2767a54-6703-4908-8414-eab6601e2ceb+41:2357:x1874687695084544:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 260us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841842.156966:0:7633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 14 00000100:00100000:0.0:1787841842.159650:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841842.160239:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695084416 00000100:00100000:1.0:1787841842.160253:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695084416 00000100:00100000:3.0:1787841842.160361:0:12018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 202 00000100:00100000:3.0:1787841842.160377:0:12018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cc00cc7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b2767a54-6703-4908-8414-eab6601e2ceb+41:11584:x1874687695084416:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:3.0:1787841842.160483:0:12018:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841842.160513:0:12018:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169b600/0xe3dac0c99afff083 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6aeb expref: -99 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841842.160642:0:12018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169ac00/0xe3dac0c99afff08a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841842.160657:0:12018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169ac00/0xe3dac0c99afff08a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841842.160668:0:12018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169ac00/0xe3dac0c99afff08a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787841842.160680:0:12018:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1787841842.161158:0:12018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169b600/0xe3dac0c99afff083 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6aeb expref: 44 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841842.161183:0:12018:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169ac00/0xe3dac0c99afff08a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6aeb expref: 43 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841842.161224:0:12018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92cbc57e3900) 00010000:00010000:3.0:1787841842.161228:0:12018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787841842.161234:0:12018:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc169ac00, rc 0) 00000100:00100000:3.0:1787841842.161376:0:12018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cc00cc7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b2767a54-6703-4908-8414-eab6601e2ceb+43:11584:x1874687695084416:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 1002us (1742us total) trans 4294967485 rc 0/0 00000100:00100000:3.0:1787841842.161456:0:12018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 202 00000100:00100000:1.0:1787841842.166790:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841842.166865:0:12388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695084672 00000100:00100000:0.0:1787841842.166889:0:12388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695084672 00000100:00100000:0.0:1787841842.167261:0:12388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 62 00000100:00100000:0.0:1787841842.167274:0:12388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac2dbed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b2767a54-6703-4908-8414-eab6601e2ceb+6:2356:x1874687695084672:12345-192.168.201.1@tcp:1:lfs.0 00010000:00010000:0.0:1787841842.167346:0:12388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000007a31d4e/0xe3dac0c99afff098 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841842.167402:0:12388:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008ac7d004/0xe3dac0c99afff059 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6ad6 expref: 6 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841842.167412:0:12388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1787841842.167418:0:12388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787841842.167424:0:12388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000007a31d4e/0xe3dac0c99afff098 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841842.167480:0:12388:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008ac7d004/0xe3dac0c99afff059 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6ad6 expref: 6 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841842.167498:0:12388:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008ac7d004/0xe3dac0c99afff059 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6ad6 expref: 6 pid: 6686 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841842.167528:0:12388:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cc00cc5e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12388:1874687714999424:192.168.201.1@tcp:104: 00000100:00100000:0.0:1787841842.167647:0:12388:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbd1ff9600 going to sleep for 11 seconds 00000100:00100000:0.0:1787841842.170170:0:12388:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cc00cc5e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12388:1874687714999424:192.168.201.1@tcp:104: 00010000:00010000:0.0:1787841842.170220:0:12388:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000007a31d4e/0xe3dac0c99afff098 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841842.172240:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841842.172532:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695084800 00000100:00100000:3.0:1787841842.172546:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695084800 00002000:00100000:3.0:1787841842.172617:0:6694:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff92cac2dbf840 x1874687695084800/t0(0) o4->b2767a54-6703-4908-8414-eab6601e2ceb@192.168.201.1@tcp:343/0 lens 504/0 e 0 to 0 dl 1787841853 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787841842.172632:0:6694:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff92cac2dbf840 with x1874687695084800 ext(0->8) 00010000:00010000:3.0:1787841842.172644:0:6694:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000008ac7d004/0xe3dac0c99afff059 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6ad6 expref: 7 pid: 6686 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841842.172664:0:6694:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000008ac7d004/0xe3dac0c99afff059 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6ad6 expref: 7 pid: 6686 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787841842.172674:0:6694:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92cac2dbf840 00000100:00100000:3.0:1787841842.172760:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 3 00000100:00100000:3.0:1787841842.172774:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac2dbf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b2767a54-6703-4908-8414-eab6601e2ceb+7:2357:x1874687695084800:12345-192.168.201.1@tcp:4:lfs.0 00000100:00100000:3.0:1787841842.173410:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac2dbf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b2767a54-6703-4908-8414-eab6601e2ceb+9:2357:x1874687695084800:12345-192.168.201.1@tcp:4:lfs.0 Request processed in 636us (1182us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1787841842.173420:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 3 00002000:00100000:3.0:1787841842.173429:0:6694:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff92cac2dbf840 x1874687695084800/t4294967308(0) o4->b2767a54-6703-4908-8414-eab6601e2ceb@192.168.201.1@tcp:343/0 lens 504/448 e 0 to 0 dl 1787841853 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787841842.173443:0:6694:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff92cac2dbf840 with x1874687695084800 ext(0->8) 00010000:00010000:3.0:1787841842.173452:0:6694:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000008ac7d004/0xe3dac0c99afff059 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6ad6 expref: 9 pid: 6686 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841842.173466:0:6694:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000008ac7d004/0xe3dac0c99afff059 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6ad6 expref: 9 pid: 6686 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787841842.173474:0:6694:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff92cac2dbf840 00000100:00100000:2.0:1787841842.177302:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841842.177776:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695084928 00000100:00100000:1.0:1787841842.177809:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695084928 00010000:00010000:1.0:1787841842.177863:0:7632:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008ac7d004/0xe3dac0c99afff059 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6ad6 expref: 9 pid: 6686 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841842.177923:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 76 00000100:00100000:1.0:1787841842.178028:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6df52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b2767a54-6703-4908-8414-eab6601e2ceb+9:2356:x1874687695084928:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787841842.178055:0:7632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787841842.178095:0:7632:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1787841842.178099:0:7632:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787841842 00002000:00010000:1.0:1787841842.178101:0:7632:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787841842 00002000:00010000:1.0:1787841842.178103:0:7632:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1787841842 00010000:00010000:1.0:1787841842.178112:0:7632:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008ac7d004/0xe3dac0c99afff059 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6ad6 expref: 9 pid: 6686 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841842.178129:0:7632:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008ac7d004/0xe3dac0c99afff059 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6ad6 expref: 9 pid: 6686 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841842.178162:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ac7d004/0xe3dac0c99afff059 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6ad6 expref: 9 pid: 6686 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841842.178183:0:7632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787841842.178188:0:7632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787841842.178194:0:7632:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000007a31d4e/0xe3dac0c99afff098 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841842.178205:0:7632:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000007a31d4e/0xe3dac0c99afff098 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841842.178263:0:7632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787841842.178357:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6df52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b2767a54-6703-4908-8414-eab6601e2ceb+8:2356:x1874687695084928:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 425us (1069us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841842.178366:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 76 00010000:00010000:0.0:1787841842.179643:0:12388:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000007a31d4e/0xe3dac0c99afff098 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841842.179663:0:12388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000007a31d4e/0xe3dac0c99afff098 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841842.179775:0:12388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000007a31d4e/0xe3dac0c99afff098 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841842.179786:0:12388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000007a31d4e/0xe3dac0c99afff098 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841842.179794:0:12388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000007a31d4e/0xe3dac0c99afff098 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841842.179801:0:12388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbffa3b400 already unused, calling callback (ffffffffc17a4500) 00010000:00010000:0.0:1787841842.179806:0:12388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000007a31d4e/0xe3dac0c99afff098 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841842.179815:0:12388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000007a31d4e/0xe3dac0c99afff098 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841842.179835:0:12388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000007a31d4e/0xe3dac0c99afff098 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841842.179845:0:12388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000007a31d4e/0xe3dac0c99afff098 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841842.179970:0:12388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac2dbed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b2767a54-6703-4908-8414-eab6601e2ceb+7:2356:x1874687695084672:12345-192.168.201.1@tcp:1:lfs.0 Request processed in 12697us (13195us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841842.179981:0:12388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 62 00000100:00100000:2.0:1787841842.185820:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841842.186288:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695085184 00000100:00100000:0.0:1787841842.186303:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695085184 00000100:00100000:0.0:1787841842.186408:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 56 00000100:00100000:0.0:1787841842.186422:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbc73ef450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b2767a54-6703-4908-8414-eab6601e2ceb+43:11584:x1874687695085184:12345-192.168.201.1@tcp:35:lfs.0 00000004:00010000:0.0:1787841842.186522:0:5841:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169ac00/0xe3dac0c99afff08a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6aeb expref: 43 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787841842.187637:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:0.0:1787841842.187813:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:0.0:1787841842.189379:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:0.0:1787841842.189607:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b400/0xe3dac0c99afff09f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841842.189636:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a200/0xe3dac0c99afff044 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6ac8 expref: 47 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841842.189647:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b400/0xe3dac0c99afff09f lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841842.189786:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a200/0xe3dac0c99afff044 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6ac8 expref: 47 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841842.189807:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a200/0xe3dac0c99afff044 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6ac8 expref: 47 pid: 5838 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841842.189825:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cc00cc5e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5841:1874687714999552:192.168.201.1@tcp:104: 00000100:00100000:0.0:1787841842.190229:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbd1ff9600 going to sleep for 11 seconds 00000100:00100000:0.0:1787841842.199393:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cc00cc5e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5841:1874687714999552:192.168.201.1@tcp:104: 00010000:00010000:0.0:1787841842.199451:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b400/0xe3dac0c99afff09f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841842.200815:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841842.201123:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695085312 00000100:00100000:1.0:1787841842.201134:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695085312 00010000:00010000:1.0:1787841842.201195:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a200/0xe3dac0c99afff044 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6ac8 expref: 48 pid: 5838 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841842.201248:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 77 00000100:00100000:1.0:1787841842.201260:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6df7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b2767a54-6703-4908-8414-eab6601e2ceb+48:2357:x1874687695085312:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787841842.201281:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787841842.201288:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a200/0xe3dac0c99afff044 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6ac8 expref: 48 pid: 5838 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841842.201304:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a200/0xe3dac0c99afff044 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6ac8 expref: 48 pid: 5838 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841842.201348:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a200/0xe3dac0c99afff044 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6ac8 expref: 48 pid: 5838 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841842.201378:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92cbc57e3900) 00010000:00010000:1.0:1787841842.201391:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b400/0xe3dac0c99afff09f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841842.201401:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b400/0xe3dac0c99afff09f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841842.201425:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b400/0xe3dac0c99afff09f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841842.202433:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787841842.202557:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6df7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b2767a54-6703-4908-8414-eab6601e2ceb+47:2357:x1874687695085312:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 1291us (1745us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841842.202572:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 77 00010000:00010000:0.0:1787841842.203275:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b400/0xe3dac0c99afff09f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841842.203288:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b400/0xe3dac0c99afff09f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787841842.203531:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:0.0:1787841842.203881:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:0.0:1787841842.204491:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cc00cc5e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5841:1874687714999680:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787841842.204597:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841842.204753:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbd1ff9000 going to sleep for 11 seconds 00000100:00100000:2.0:1787841842.216593:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714999680 00000100:00100000:2.0:1787841842.216640:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714999680 00000100:00100000:2.0:1787841842.216917:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787841842.216941:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cc00cc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5841:x1874687714999680:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787841842.217999:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cc00cc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5841:x1874687714999680:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 1061us (13393us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841842.218014:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787841842.220894:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cc00cc5e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5841:1874687714999680:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1787841842.222747:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:1.0:1787841842.222913:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff42ed00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5841:1874687714999808:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787841842.223213:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841842.223274:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc2e21180 going to sleep for 11 seconds 00000100:00100000:2.0:1787841842.223588:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714999808 00000100:00100000:2.0:1787841842.223600:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714999808 00000100:00100000:2.0:1787841842.223690:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787841842.223738:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e28f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5841:x1874687714999808:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787841842.224080:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e28f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5841:x1874687714999808:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 335us (856us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1787841842.224219:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1787841842.224405:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787841842.224684:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff42ed00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5841:1874687714999808:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1787841842.224844:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:1.0:1787841842.225607:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b400/0xe3dac0c99afff09f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841842.225624:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b400/0xe3dac0c99afff09f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841842.225633:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b400/0xe3dac0c99afff09f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841842.225641:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbffa3b400 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:1.0:1787841842.225646:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b400/0xe3dac0c99afff09f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841842.225655:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b400/0xe3dac0c99afff09f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841842.225814:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92cbc57e3900) 00010000:00010000:1.0:1787841842.225818:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787841842.225827:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b400/0xe3dac0c99afff09f lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841842.225835:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b400/0xe3dac0c99afff09f lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787841842.226515:0:5841:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1787841842.226682:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:1.0:1787841842.226810:0:5841:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 382225111650ns, next at 383225105563ns, rc = 0 00000001:00080000:1.0:1787841842.226823:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:1.0:1787841842.226888:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92cbc57e3900) 00010000:00010000:1.0:1787841842.226893:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787841842.226906:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169ac00/0xe3dac0c99afff08a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6aeb expref: 51 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841842.227555:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbc73ef450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b2767a54-6703-4908-8414-eab6601e2ceb+50:11584:x1874687695085184:12345-192.168.201.1@tcp:35:lfs.0 Request processed in 41132us (41748us total) trans 4294967494 rc 0/0 00000100:00100000:1.0:1787841842.227570:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 56 00000020:00080000:1.0:1787841842.227578:0:5841:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1787841842.233637:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841842.234015:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695085440 00000100:00100000:3.0:1787841842.234035:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695085440 00000100:00100000:3.0:1787841842.234291:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 203 00000100:00100000:3.0:1787841842.234317:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cc00cc70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+50:11584:x1874687695085440:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:3.0:1787841842.234372:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841842.234415:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169b600/0xe3dac0c99afff0a6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6af2 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841842.234527:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169b600/0xe3dac0c99afff0a6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6af2 expref: 51 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841842.234550:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169b600/0xe3dac0c99afff0a6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6af2 expref: 51 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841842.234580:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92cbc89cd700) 00010000:00010000:3.0:1787841842.234584:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787841842.234590:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc169b600, rc 0) 00000100:00100000:3.0:1787841842.235024:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cc00cc70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+51:11584:x1874687695085440:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 718us (1408us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841842.235202:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 203 00000100:00100000:0.0:1787841842.240678:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841842.241292:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695085696 00000100:00100000:1.0:1787841842.241319:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695085696 00000100:00100000:1.0:1787841842.241799:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 57 00000100:00100000:1.0:1787841842.241817:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cc00cc6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b2767a54-6703-4908-8414-eab6601e2ceb+51:11584:x1874687695085696:12345-192.168.201.1@tcp:35:lfs.0 00000100:00100000:1.0:1787841842.242800:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cc00cc6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b2767a54-6703-4908-8414-eab6601e2ceb+52:11584:x1874687695085696:12345-192.168.201.1@tcp:35:lfs.0 Request processed in 982us (2142us total) trans 4294967495 rc 0/0 00000100:00100000:1.0:1787841842.242838:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 57 00000100:00100000:2.0:1787841842.409452:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841842.409771:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695085824 00000100:00100000:0.0:1787841842.409785:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695085824 00000100:00100000:0.0:1787841842.409878:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 204 00000100:00100000:0.0:1787841842.409891:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6df4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+52:11594:x1874687695085824:12345-192.168.201.1@tcp:34:lfs.0 00010000:00010000:0.0:1787841842.410015:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3aa00/0xe3dac0c99afff0ad lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841842.410038:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3aa00/0xe3dac0c99afff0ad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841842.410053:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3aa00/0xe3dac0c99afff0ad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841842.410072:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99afff0b4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841842.410102:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99afff0b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841842.410109:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99afff0b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841842.410244:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b000/0xe3dac0c99afff0bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841842.410254:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b000/0xe3dac0c99afff0bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841842.410261:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b000/0xe3dac0c99afff0bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787841842.410327:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b000/0xe3dac0c99afff0bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841842.410342:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3aa00/0xe3dac0c99afff0ad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841842.410348:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3aa00/0xe3dac0c99afff0ad lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841842.410355:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3aa00/0xe3dac0c99afff0ad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841842.410361:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbffa3aa00 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:0.0:1787841842.410366:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3aa00/0xe3dac0c99afff0ad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841842.410376:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3aa00/0xe3dac0c99afff0ad lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841842.410397:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92cbc57e3e00) 00010000:00010000:0.0:1787841842.410401:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841842.410407:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3aa00/0xe3dac0c99afff0ad lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841842.410413:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3aa00/0xe3dac0c99afff0ad lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841842.410430:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99afff0b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841842.410435:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99afff0b4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841842.410440:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99afff0b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841842.410445:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbffa3be00 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:0.0:1787841842.410447:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99afff0b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841842.410453:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99afff0b4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841842.410460:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff92cbc57e3600) 00010000:00010000:0.0:1787841842.410462:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841842.410465:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99afff0b4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841842.410470:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99afff0b4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841842.410496:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b000/0xe3dac0c99afff0bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841842.410504:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b000/0xe3dac0c99afff0bb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841842.410521:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b000/0xe3dac0c99afff0bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841842.410527:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbffa3b000 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:0.0:1787841842.410530:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b000/0xe3dac0c99afff0bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841842.410536:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b000/0xe3dac0c99afff0bb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841842.410543:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92cbc89cd700) 00010000:00010000:0.0:1787841842.410546:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841842.410548:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b000/0xe3dac0c99afff0bb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841842.410553:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b000/0xe3dac0c99afff0bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841842.410679:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6df4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+52:11594:x1874687695085824:12345-192.168.201.1@tcp:34:lfs.0 Request processed in 788us (1242us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841842.410688:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 204 00000100:00100000:1.0:1787841842.433449:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6df5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874687714999936:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787841842.433576:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841842.433756:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687714999936 00000100:00100000:2.0:1787841842.433765:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687714999936 00000100:00100000:2.0:1787841842.433835:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787841842.433848:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e28b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1874687714999936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787841842.433909:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787841842.434692:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e28b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1874687714999936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 843us (1112us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841842.434730:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787841842.435485:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6df5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874687714999936:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787841842.437735:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787841842.458822:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841842.459498:0:12018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695086080 00000100:00100000:3.0:1787841842.459585:0:12018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695086080 00000100:00100000:3.0:1787841842.459875:0:12018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 205 00000100:00100000:3.0:1787841842.459890:0:12018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cc00cc4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b2767a54-6703-4908-8414-eab6601e2ceb+52:11597:x1874687695086080:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:3.0:1787841842.459920:0:12018:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841842.459964:0:12018:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169ac00/0xe3dac0c99afff0c2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6af9 expref: -99 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841842.460072:0:12018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99afff0c9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841842.460176:0:12018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99afff0c9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841842.460190:0:12018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99afff0c9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841842.460206:0:12018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99afff0d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841842.460211:0:12018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99afff0d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841842.460215:0:12018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99afff0d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841842.460379:0:12018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99afff0d7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841842.460411:0:12018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99afff0d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841842.460419:0:12018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99afff0d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787841842.460432:0:12018:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1787841842.460579:0:12018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99afff0c9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841842.460587:0:12018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99afff0c9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841842.460594:0:12018:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99afff0c9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841842.460600:0:12018:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc149d400 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:3.0:1787841842.460605:0:12018:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99afff0c9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841842.460614:0:12018:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99afff0c9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841842.460631:0:12018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92cbc57e3e00) 00010000:00010000:3.0:1787841842.460634:0:12018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787841842.460640:0:12018:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99afff0c9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841842.460645:0:12018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99afff0c9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841842.460662:0:12018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99afff0d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841842.460952:0:12018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99afff0d0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841842.460960:0:12018:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99afff0d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841842.460966:0:12018:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc149c400 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:3.0:1787841842.460970:0:12018:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99afff0d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841842.460977:0:12018:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99afff0d0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841842.460986:0:12018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff92cbc89cd100) 00010000:00010000:3.0:1787841842.460988:0:12018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787841842.460992:0:12018:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99afff0d0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841842.460998:0:12018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99afff0d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841842.461056:0:12018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169ac00/0xe3dac0c99afff0c2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6af9 expref: 55 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841842.461077:0:12018:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99afff0d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6af9 expref: 54 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841842.461088:0:12018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92cbc89cd700) 00010000:00010000:3.0:1787841842.461089:0:12018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787841842.461096:0:12018:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc149d600, rc 0) 00000100:00100000:3.0:1787841842.461176:0:12018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cc00cc4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b2767a54-6703-4908-8414-eab6601e2ceb+54:11597:x1874687695086080:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 1291us (2369us total) trans 4294967496 rc 0/0 00000100:00100000:3.0:1787841842.461184:0:12018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 205 00000100:00100000:2.0:1787841842.465253:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841842.465424:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695086208 00000100:00100000:3.0:1787841842.465437:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695086208 00000100:00100000:3.0:1787841842.465524:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 206 00000100:00100000:3.0:1787841842.465536:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6df5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+54:11597:x1874687695086208:12345-192.168.201.1@tcp:54:lfs.0 00010000:00010000:3.0:1787841842.465682:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99afff0e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841842.465738:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99afff0e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841842.465751:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99afff0e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841842.465786:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99afff0e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841842.465792:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99afff0e5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841842.465797:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99afff0e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841842.465801:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc149c000 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:3.0:1787841842.465806:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99afff0e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841842.465812:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99afff0e5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841842.465832:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92cbc89cd700) 00010000:00010000:3.0:1787841842.465834:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787841842.465840:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99afff0e5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841842.465845:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99afff0e5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841842.465992:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6df5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+54:11597:x1874687695086208:12345-192.168.201.1@tcp:54:lfs.0 Request processed in 459us (751us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841842.465998:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 206 00000100:00100000:2.0:1787841842.468246:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841842.468348:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695086464 00000100:00100000:0.0:1787841842.468377:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695086464 00000100:00100000:0.0:1787841842.468487:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 58 00000100:00100000:0.0:1787841842.468499:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6df61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b2767a54-6703-4908-8414-eab6601e2ceb+54:11597:x1874687695086464:12345-192.168.201.1@tcp:35:lfs.0 00000100:00100000:0.0:1787841842.468853:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6df61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b2767a54-6703-4908-8414-eab6601e2ceb+55:11597:x1874687695086464:12345-192.168.201.1@tcp:35:lfs.0 Request processed in 357us (617us total) trans 4294967497 rc 0/0 00000100:00100000:0.0:1787841842.468860:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 58 00000100:00100000:2.0:1787841842.533572:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841842.533738:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695086720 00000100:00100000:1.0:1787841842.533753:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695086720 00000100:00100000:1.0:1787841842.533839:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 207 00000100:00100000:1.0:1787841842.533853:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6df4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2767a54-6703-4908-8414-eab6601e2ceb+55:11607:x1874687695086720:12345-192.168.201.1@tcp:101:bash.0 00010000:00010000:1.0:1787841842.533905:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841842.533909:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787841842.533961:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169ba00/0xe3dac0c99afff067 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6add expref: 55 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841842.533988:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92cbc57e3e00) 00010000:00010000:1.0:1787841842.533995:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787841842.534014:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99afff0ec lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6b00 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841842.534157:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c400/0xe3dac0c99afff0f3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841842.534175:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99afff0d7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6af9 expref: 55 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841842.534186:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c400/0xe3dac0c99afff0f3 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841842.534255:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99afff0d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6af9 expref: 55 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841842.534273:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99afff0d7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6af9 expref: 55 pid: 12018 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841842.534290:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e29e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5838:1874687715000064:192.168.201.1@tcp:104: 00000100:00100000:1.0:1787841842.534440:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc2e21a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787841842.542394:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841842.542744:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695086848 00000100:00100000:3.0:1787841842.542755:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695086848 00010000:00010000:3.0:1787841842.542808:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99afff0d7 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6af9 expref: 56 pid: 12018 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841842.542854:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 78 00000100:00100000:3.0:1787841842.542862:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6df7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b2767a54-6703-4908-8414-eab6601e2ceb+56:2357:x1874687695086848:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787841842.542896:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787841842.542905:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99afff0d7 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6af9 expref: 56 pid: 12018 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841842.542921:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99afff0d7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6af9 expref: 56 pid: 12018 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841842.542961:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92cbc89cd700) 00010000:00010000:3.0:1787841842.542967:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c400/0xe3dac0c99afff0f3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841842.542998:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c400/0xe3dac0c99afff0f3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841842.543005:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c400/0xe3dac0c99afff0f3 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841842.543028:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787841842.543313:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6df7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b2767a54-6703-4908-8414-eab6601e2ceb+56:2357:x1874687695086848:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 442us (938us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841842.543321:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 78 00010000:00010000:1.0:1787841842.544478:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99afff0d7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6af9 expref: 55 pid: 12018 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841842.544508:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e29e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5838:1874687715000064:192.168.201.1@tcp:104: 00010000:00010000:1.0:1787841842.544542:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c400/0xe3dac0c99afff0f3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841842.544554:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c400/0xe3dac0c99afff0f3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841842.544561:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c400/0xe3dac0c99afff0f3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787841842.544588:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1787841842.545068:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99afff0ec lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b00 expref: 56 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841842.545196:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c400/0xe3dac0c99afff0f3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b00 expref: 55 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841842.545225:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92cbc89cd700) 00010000:00010000:1.0:1787841842.545228:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787841842.545231:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cc00d9c400, rc 0) 00000100:00100000:1.0:1787841842.545315:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6df4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2767a54-6703-4908-8414-eab6601e2ceb+55:11607:x1874687695086720:12345-192.168.201.1@tcp:101:bash.0 Request processed in 11465us (11758us total) trans 4294967498 rc 0/0 00000100:00100000:1.0:1787841842.545325:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 207 00000100:00100000:2.0:1787841842.549066:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841842.549318:0:12018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695087104 00000100:00100000:3.0:1787841842.549333:0:12018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695087104 00000100:00100000:3.0:1787841842.549468:0:12018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 208 00000100:00100000:3.0:1787841842.549482:0:12018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6df7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b2767a54-6703-4908-8414-eab6601e2ceb+55:11607:x1874687695087104:12345-192.168.201.1@tcp:36:bash.0 00010000:00010000:3.0:1787841842.549914:0:12018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99afff101 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841842.549951:0:12018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99afff101 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841842.549966:0:12018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99afff101 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787841842.550054:0:12018:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:3.0:1787841842.550271:0:12018:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e25e7a70 reply state 00000000c528a0a0 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99afff101 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841842.550282:0:12018:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787841842.550470:0:12018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6df7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b2767a54-6703-4908-8414-eab6601e2ceb+58:11607:x1874687695087104:12345-192.168.201.1@tcp:36:bash.0 Request processed in 990us (1419us total) trans 4294967500 rc 0/0 00000100:00100000:3.0:1787841842.550486:0:12018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 208 00000020:00080000:3.0:1787841842.550492:0:12018:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787841842.552727:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99afff101 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841842.552750:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99afff101 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841842.552760:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99afff101 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841842.552767:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc149c000 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:0.0:1787841842.552774:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99afff101 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841842.552785:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99afff101 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841842.552809:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92cbc89cd700) 00010000:00010000:0.0:1787841842.552813:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841842.552819:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99afff101 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841842.552827:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99afff101 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841842.553518:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841842.553567:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695087232 00000100:00100000:0.0:1787841842.553598:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695087232 00000100:00100000:0.0:1787841842.553674:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 209 00000100:00100000:0.0:1787841842.553685:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6df5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+57:11607:x1874687695087232:12345-192.168.201.1@tcp:101:bash.0 00010000:00010000:0.0:1787841842.553753:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841842.553777:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b000/0xe3dac0c99afff108 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6b07 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841842.553884:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99afff10f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841842.553901:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c400/0xe3dac0c99afff0f3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b00 expref: 58 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841842.553911:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99afff10f lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841842.553952:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c400/0xe3dac0c99afff0f3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b00 expref: 58 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841842.553968:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c400/0xe3dac0c99afff0f3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b00 expref: 58 pid: 5838 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841842.553985:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cc00cc6580 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1874687715000192:192.168.201.1@tcp:104: 00000100:00100000:0.0:1787841842.554093:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbd1ff9900 going to sleep for 11 seconds 00000100:00100000:0.0:1787841842.556873:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cc00cc6580 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1874687715000192:192.168.201.1@tcp:104: 00010000:00010000:0.0:1787841842.556915:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99afff10f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841842.557342:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841842.557387:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695087360 00000100:00100000:3.0:1787841842.557397:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695087360 00010000:00010000:3.0:1787841842.557450:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c400/0xe3dac0c99afff0f3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b00 expref: 59 pid: 5838 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841842.557489:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 79 00000100:00100000:3.0:1787841842.557499:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6df5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b2767a54-6703-4908-8414-eab6601e2ceb+59:2357:x1874687695087360:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787841842.557519:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787841842.557527:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c400/0xe3dac0c99afff0f3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b00 expref: 59 pid: 5838 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841842.557540:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c400/0xe3dac0c99afff0f3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b00 expref: 59 pid: 5838 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841842.557566:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c400/0xe3dac0c99afff0f3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b00 expref: 59 pid: 5838 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841842.557582:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92cbc89cd700) 00010000:00010000:3.0:1787841842.557586:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99afff10f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841842.557595:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99afff10f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841842.557601:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99afff10f lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841842.557644:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787841842.557677:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99afff10f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841842.557748:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6df5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b2767a54-6703-4908-8414-eab6601e2ceb+58:2357:x1874687695087360:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 248us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841842.557758:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 79 00010000:00010000:0.0:1787841842.557775:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99afff10f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787841842.557850:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1787841842.557856:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787841842.557884:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99afff10f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841842.557933:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b000/0xe3dac0c99afff108 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b07 expref: 58 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841842.557953:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99afff10f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b07 expref: 57 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841842.557962:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92cbc89cd700) 00010000:00010000:0.0:1787841842.557965:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787841842.557968:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbffa3be00, rc 0) 00000100:00100000:0.0:1787841842.558006:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6df5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+57:11607:x1874687695087232:12345-192.168.201.1@tcp:101:bash.0 Request processed in 4323us (4493us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841842.558015:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 209 00000100:00100000:2.0:1787841842.563180:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841842.563258:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695087616 00000100:00100000:1.0:1787841842.563275:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695087616 00000100:00100000:1.0:1787841842.563395:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 59 00000100:00100000:1.0:1787841842.563408:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6df6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b2767a54-6703-4908-8414-eab6601e2ceb+57:11607:x1874687695087616:12345-192.168.201.1@tcp:35:bash.0 00000100:00100000:1.0:1787841842.563769:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6df6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b2767a54-6703-4908-8414-eab6601e2ceb+58:11607:x1874687695087616:12345-192.168.201.1@tcp:35:bash.0 Request processed in 362us (603us total) trans 4294967501 rc 0/0 00000100:00100000:1.0:1787841842.563778:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 59 00000100:00100000:2.0:1787841842.616100:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841842.616364:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695087744 00000100:00100000:1.0:1787841842.616391:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695087744 00000100:00100000:1.0:1787841842.616505:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 210 00000100:00100000:1.0:1787841842.616520:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6df6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2767a54-6703-4908-8414-eab6601e2ceb+58:11613:x1874687695087744:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:1.0:1787841842.616570:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841842.616604:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99afff116 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6b0e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841842.616767:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99afff11d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841842.616791:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99afff11d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841842.616833:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99afff11d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787841842.616951:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:1.0:1787841842.616955:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787841842.616990:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99afff11d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841842.617028:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99afff116 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b0e expref: 60 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841842.617060:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99afff11d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b0e expref: 59 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841842.617072:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92cbc57e3e00) 00010000:00010000:1.0:1787841842.617075:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787841842.617670:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cc00d9d600, rc 0) 00000100:00100000:1.0:1787841842.617886:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6df6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2767a54-6703-4908-8414-eab6601e2ceb+59:11613:x1874687695087744:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 1367us (1815us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841842.617897:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 210 00000100:00100000:2.0:1787841842.622913:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841842.623406:0:12018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695087872 00000100:00100000:3.0:1787841842.623424:0:12018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695087872 00000100:00100000:3.0:1787841842.623524:0:12018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 211 00000100:00100000:3.0:1787841842.623539:0:12018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6df43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b2767a54-6703-4908-8414-eab6601e2ceb+59:11613:x1874687695087872:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:3.0:1787841842.623575:0:12018:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841842.623608:0:12018:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99afff124 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6b15 expref: -99 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841842.623729:0:12018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99afff12b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841842.623749:0:12018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99afff12b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841842.623768:0:12018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99afff12b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841842.623787:0:12018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149de00/0xe3dac0c99afff132 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841842.623794:0:12018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149de00/0xe3dac0c99afff132 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841842.623803:0:12018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149de00/0xe3dac0c99afff132 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841842.624048:0:12018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99afff139 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841842.624060:0:12018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99afff139 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841842.624067:0:12018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99afff139 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787841842.624323:0:12018:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1787841842.624330:0:12018:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787841842.624359:0:12018:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99afff139 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841842.624378:0:12018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99afff139 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841842.624390:0:12018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99afff12b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841842.624398:0:12018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99afff12b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841842.624406:0:12018:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99afff12b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841842.624413:0:12018:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc149d400 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:3.0:1787841842.624419:0:12018:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99afff12b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841842.624428:0:12018:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99afff12b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841842.624455:0:12018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92cbc57e3e00) 00010000:00010000:3.0:1787841842.624459:0:12018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787841842.624467:0:12018:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99afff12b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841842.624475:0:12018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d400/0xe3dac0c99afff12b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841842.624498:0:12018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149de00/0xe3dac0c99afff132 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841842.624505:0:12018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149de00/0xe3dac0c99afff132 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841842.624512:0:12018:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149de00/0xe3dac0c99afff132 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841842.624518:0:12018:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc149de00 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:3.0:1787841842.624521:0:12018:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149de00/0xe3dac0c99afff132 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841842.624528:0:12018:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149de00/0xe3dac0c99afff132 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841842.624536:0:12018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff92cbc89cd100) 00010000:00010000:3.0:1787841842.624538:0:12018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787841842.624541:0:12018:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149de00/0xe3dac0c99afff132 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841842.624547:0:12018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149de00/0xe3dac0c99afff132 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841842.624604:0:12018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c400/0xe3dac0c99afff124 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b15 expref: 61 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841842.624620:0:12018:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99afff139 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b15 expref: 60 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841842.624630:0:12018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92cbc89cd700) 00010000:00010000:3.0:1787841842.624632:0:12018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787841842.624635:0:12018:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc149c000, rc 0) 00000100:00100000:3.0:1787841842.624802:0:12018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6df43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b2767a54-6703-4908-8414-eab6601e2ceb+60:11613:x1874687695087872:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 1267us (1908us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841842.624812:0:12018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 211 00000100:00100000:2.0:1787841842.629235:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841842.629318:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841842.629455:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695088256 00000100:00100000:3.0:1787841842.629472:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695088256 00000100:00100000:3.0:1787841842.629572:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 15 00000100:00100000:3.0:1787841842.629582:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6dfed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b2767a54-6703-4908-8414-eab6601e2ceb+60:2355:x1874687695088256:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787841842.629601:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787841842.629644:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99afff139 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b15 expref: 60 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841842.629668:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92cbc89cd700) 00010000:00010000:3.0:1787841842.629675:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787841842.629782:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6dfed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b2767a54-6703-4908-8414-eab6601e2ceb+59:2355:x1874687695088256:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 203us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841842.629790:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 15 00000100:00100000:0.0:1787841842.630289:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695088128 00000100:00100000:0.0:1787841842.630295:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695088128 00000100:00100000:0.0:1787841842.630348:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 212 00000100:00100000:0.0:1787841842.630358:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff40a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+59:11613:x1874687695088128:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:0.0:1787841842.630388:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841842.630411:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3aa00/0xe3dac0c99afff140 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6b1c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841842.630565:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a800/0xe3dac0c99afff147 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841842.630580:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99afff10f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b07 expref: 60 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841842.630587:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a800/0xe3dac0c99afff147 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841842.630625:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99afff10f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b07 expref: 60 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841842.630637:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99afff10f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b07 expref: 60 pid: 5837 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841842.630650:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cc00cc6580 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1874687715000320:192.168.201.1@tcp:104: 00000100:00100000:0.0:1787841842.630767:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbd1ff9900 going to sleep for 11 seconds 00000100:00100000:2.0:1787841842.634644:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841842.634749:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695088384 00000100:00100000:1.0:1787841842.634763:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695088384 00010000:00010000:1.0:1787841842.634834:0:7632:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99afff10f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b07 expref: 61 pid: 5837 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841842.634890:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 80 00000100:00100000:1.0:1787841842.634899:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6dfd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b2767a54-6703-4908-8414-eab6601e2ceb+61:2357:x1874687695088384:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787841842.634944:0:7632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787841842.634956:0:7632:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99afff10f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b07 expref: 61 pid: 5837 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841842.634980:0:7632:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99afff10f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b07 expref: 61 pid: 5837 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841842.635024:0:7632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92cbc89cd700) 00010000:00010000:1.0:1787841842.635030:0:7632:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a800/0xe3dac0c99afff147 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841842.635039:0:7632:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a800/0xe3dac0c99afff147 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841842.635049:0:7632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a800/0xe3dac0c99afff147 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841842.635089:0:7632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787841842.635174:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6dfd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b2767a54-6703-4908-8414-eab6601e2ceb+61:2357:x1874687695088384:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 275us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841842.635181:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 80 00010000:00010000:0.0:1787841842.635851:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99afff10f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b07 expref: 60 pid: 5837 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841842.635884:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cc00cc6580 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1874687715000320:192.168.201.1@tcp:104: 00010000:00010000:0.0:1787841842.635932:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a800/0xe3dac0c99afff147 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841842.635946:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a800/0xe3dac0c99afff147 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841842.635971:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a800/0xe3dac0c99afff147 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787841842.636014:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1787841842.636331:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3aa00/0xe3dac0c99afff140 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b1c expref: 61 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841842.636354:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a800/0xe3dac0c99afff147 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b1c expref: 60 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841842.636364:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92cbc89cd700) 00010000:00010000:0.0:1787841842.636367:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787841842.636370:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbffa3a800, rc 0) 00000100:00100000:0.0:1787841842.636438:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff40a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+60:11613:x1874687695088128:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 6084us (7220us total) trans 4294967502 rc 0/0 00000100:00100000:0.0:1787841842.636447:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 212 00000100:00100000:2.0:1787841842.640806:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841842.641251:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695088640 00000100:00100000:3.0:1787841842.641290:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695088640 00000100:00100000:3.0:1787841842.641426:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 16 00000100:00100000:3.0:1787841842.641441:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcdb78c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b2767a54-6703-4908-8414-eab6601e2ceb+60:11613:x1874687695088640:12345-192.168.201.1@tcp:103:lfs.0 00010000:00010000:3.0:1787841842.641465:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787841842.641505:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc169b600/0xe3dac0c99afff0a6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6af2 expref: 60 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841842.641535:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92cbc89cd700) 00010000:00010000:3.0:1787841842.641544:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787841842.641647:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcdb78c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b2767a54-6703-4908-8414-eab6601e2ceb+59:11613:x1874687695088640:12345-192.168.201.1@tcp:103:lfs.0 Request processed in 208us (875us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841842.641656:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 16 00000100:00100000:2.0:1787841842.644681:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841842.644839:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695088768 00000100:00100000:1.0:1787841842.644856:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695088768 00000100:00100000:1.0:1787841842.644956:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 213 00000100:00100000:1.0:1787841842.644968:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6dffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2767a54-6703-4908-8414-eab6601e2ceb+59:11613:x1874687695088768:12345-192.168.201.1@tcp:58:lfs.0 00010000:00010000:1.0:1787841842.645330:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99afff155 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841842.645360:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99afff155 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841842.645549:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99afff155 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787841842.646239:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:1.0:1787841842.646409:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6dffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2767a54-6703-4908-8414-eab6601e2ceb+59:11613:x1874687695088768:12345-192.168.201.1@tcp:58:lfs.0 Request processed in 1439us (1744us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841842.646422:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 213 00000100:00100000:2.0:1787841842.651387:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841842.651530:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695088896 00000100:00100000:0.0:1787841842.651547:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695088896 00000100:00100000:0.0:1787841842.651663:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 214 00000100:00100000:0.0:1787841842.651678:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6dfc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+59:11613:x1874687695088896:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:0.0:1787841842.651779:0:9449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841842.651812:0:9449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3aa00/0xe3dac0c99afff15c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6b23 expref: -99 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841842.652073:0:9449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99afff155 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841842.652226:0:9449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3aa00/0xe3dac0c99afff15c lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b23 expref: 60 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841842.652252:0:9449:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99afff155 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841842.652276:0:9449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3aa00/0xe3dac0c99afff15c lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b23 expref: 60 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841842.652295:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92cbc89cd700) 00010000:00010000:0.0:1787841842.652299:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787841842.652315:0:9449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3aa00/0xe3dac0c99afff15c lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b23 expref: 60 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841842.652327:0:9449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbffa3aa00, rc 0) 00000100:00100000:0.0:1787841842.652446:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6dfc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+60:11613:x1874687695088896:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 771us (1087us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841842.652454:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 214 00010000:00010000:2.0:1787841842.753637:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787841843.074596:0:11682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787841843.074611:0:11682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787841843.074676:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:1.0:1787841843.074685:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787841843.075442:0:11682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e29e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11682:1874687715000448:192.168.201.1@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787841843.075694:0:11682:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc2e21a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787841843.089515:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841843.089552:0:11682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e29e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11682:1874687715000448:192.168.201.1@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787841843.089647:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695089024 00000100:00100000:0.0:1787841843.089660:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695089024 00000100:00100000:0.0:1787841843.089808:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 215 00000100:00100000:0.0:1787841843.089820:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6dfd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+60:11614:x1874687695089024:12345-192.168.201.1@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787841843.089859:0:5837:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00080000:2.0:1787841843.089965:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787841843.090361:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6dfd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+60:11614:x1874687695089024:12345-192.168.201.1@tcp:53:lhsmtool_posix.0 Request processed in 541us (865us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841843.090371:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 215 00000100:00100000:2.0:1787841843.096475:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841843.096873:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695089152 00000100:00100000:1.0:1787841843.096898:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695089152 00000100:00100000:1.0:1787841843.096987:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 216 00000100:00100000:1.0:1787841843.097238:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6dfda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2767a54-6703-4908-8414-eab6601e2ceb+60:11614:x1874687695089152:12345-192.168.201.1@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787841843.097356:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d800/0xe3dac0c99afff163 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.097389:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d800/0xe3dac0c99afff163 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.097407:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d800/0xe3dac0c99afff163 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.097451:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99afff16a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.097458:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99afff16a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.097464:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99afff16a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.097492:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9da00/0xe3dac0c99afff171 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.097501:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9da00/0xe3dac0c99afff171 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.097507:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9da00/0xe3dac0c99afff171 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787841843.097569:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1787841843.097576:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787841843.097620:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9da00/0xe3dac0c99afff171 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.097634:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d800/0xe3dac0c99afff163 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.097642:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d800/0xe3dac0c99afff163 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.097649:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d800/0xe3dac0c99afff163 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.097666:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cc00d9d800 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:1.0:1787841843.097850:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d800/0xe3dac0c99afff163 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.097860:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d800/0xe3dac0c99afff163 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.097876:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff92cbc57e3b00) 00010000:00010000:1.0:1787841843.098084:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787841843.098093:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d800/0xe3dac0c99afff163 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.098101:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d800/0xe3dac0c99afff163 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.098119:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99afff16a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.098125:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99afff16a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.098130:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99afff16a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.098135:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cc00d9d400 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:1.0:1787841843.098138:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99afff16a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.098144:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99afff16a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.098164:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff92cbd1fc7700) 00010000:00010000:1.0:1787841843.098166:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787841843.098169:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99afff16a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.098175:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99afff16a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.098191:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9da00/0xe3dac0c99afff171 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.098196:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9da00/0xe3dac0c99afff171 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.098201:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9da00/0xe3dac0c99afff171 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.098206:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cc00d9da00 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:1.0:1787841843.098209:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9da00/0xe3dac0c99afff171 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.098214:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9da00/0xe3dac0c99afff171 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.098221:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92cbc89cd700) 00010000:00010000:1.0:1787841843.098223:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787841843.098227:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9da00/0xe3dac0c99afff171 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.098232:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9da00/0xe3dac0c99afff171 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841843.098379:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6dfda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2767a54-6703-4908-8414-eab6601e2ceb+60:11614:x1874687695089152:12345-192.168.201.1@tcp:34:lhsmtool_posix.0 Request processed in 1370us (1909us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841843.098391:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 216 00000100:00100000:2.0:1787841843.110044:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841843.110322:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695089408 00000100:00100000:3.0:1787841843.110337:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695089408 00000100:00100000:3.0:1787841843.110414:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 217 00000100:00100000:3.0:1787841843.110427:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6dfe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+60:11614:x1874687695089408:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787841843.110458:0:9449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841843.110487:0:9449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99afff178 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6b2a expref: -99 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841843.110628:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99afff17f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841843.110648:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99afff17f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841843.110661:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99afff17f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787841843.110745:0:9449:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1787841843.110881:0:9449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99afff17f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841843.110890:0:9449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99afff17f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841843.110897:0:9449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99afff17f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841843.110904:0:9449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc149c000 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:3.0:1787841843.110909:0:9449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99afff17f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841843.110916:0:9449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99afff17f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841843.110930:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92cbc89cd700) 00010000:00010000:3.0:1787841843.110934:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787841843.110939:0:9449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99afff17f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841843.110947:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99afff17f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841843.110997:0:9449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99afff178 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b2a expref: 62 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841843.111008:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff92cbc57e3b00) 00010000:00010000:3.0:1787841843.111011:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787841843.111022:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99afff178 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b2a expref: 62 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841843.111034:0:9449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc149d600, rc 0) 00000100:00100000:3.0:1787841843.111116:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6dfe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+61:11614:x1874687695089408:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 Request processed in 691us (1086us total) trans 4294967503 rc 301/301 00000100:00100000:3.0:1787841843.111124:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 217 00000100:00100000:0.0:1787841843.127775:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841843.128009:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695089536 00000100:00100000:2.0:1787841843.128025:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695089536 00000100:00100000:2.0:1787841843.128108:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 218 00000100:00100000:2.0:1787841843.128122:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cc00cc6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+61:11614:x1874687695089536:12345-192.168.201.1@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787841843.128176:0:5837:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787841843.128368:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cc00cc6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+61:11614:x1874687695089536:12345-192.168.201.1@tcp:53:lhsmtool_posix.0 Request processed in 248us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841843.128378:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 218 00000100:00100000:2.0:1787841843.140781:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841843.142010:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695089792 00000100:00100000:1.0:1787841843.142030:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695089792 00000100:00100000:1.0:1787841843.142145:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 219 00000100:00100000:1.0:1787841843.142160:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6dfcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2767a54-6703-4908-8414-eab6601e2ceb+61:11614:x1874687695089792:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787841843.142196:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841843.142201:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787841843.142246:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99afff11d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b0e expref: 61 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.142276:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92cbc57e3e00) 00010000:00010000:1.0:1787841843.142284:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787841843.142315:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9da00/0xe3dac0c99afff18d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6b31 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787841843.143094:0:5838:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:1.0:1787841843.143422:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99afff194 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.143441:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99afff194 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.143456:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99afff194 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.143533:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9da00/0xe3dac0c99afff18d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b31 expref: 63 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.143578:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99afff194 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b31 expref: 62 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.143586:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff92cbd1fc7700) 00010000:00010000:1.0:1787841843.143589:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787841843.143592:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cc00d9d400, rc 0) 00000100:00100000:1.0:1787841843.143920:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6dfcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2767a54-6703-4908-8414-eab6601e2ceb+62:11614:x1874687695089792:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 Request processed in 1762us (3227us total) trans 4294967504 rc 0/0 00000100:00100000:1.0:1787841843.143931:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 219 00000100:00100000:3.0:1787841843.155803:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841843.155873:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695090048 00000100:00100000:0.0:1787841843.155888:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695090048 00000100:00100000:0.0:1787841843.155977:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 220 00000100:00100000:0.0:1787841843.155991:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac11143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+62:11614:x1874687695090048:12345-192.168.201.1@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787841843.156081:0:9449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787841843.156125:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99afff194 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b31 expref: 62 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841843.156155:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff92cbd1fc7700) 00010000:00010000:0.0:1787841843.156170:0:9449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787841843.156205:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b600/0xe3dac0c99afff1a2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841843.156225:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b600/0xe3dac0c99afff1a2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841843.156239:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b600/0xe3dac0c99afff1a2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841843.156257:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a000/0xe3dac0c99afff1a9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x56f351e7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841843.156264:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a000/0xe3dac0c99afff1a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x56f351e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841843.156270:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a000/0xe3dac0c99afff1a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x56f351e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841843.156382:0:9449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b600/0xe3dac0c99afff1a2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841843.156412:0:9449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b600/0xe3dac0c99afff1a2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841843.156419:0:9449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b600/0xe3dac0c99afff1a2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841843.156426:0:9449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbffa3b600 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:0.0:1787841843.156431:0:9449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b600/0xe3dac0c99afff1a2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841843.156441:0:9449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b600/0xe3dac0c99afff1a2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841843.156451:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92cbc57e3e00) 00010000:00010000:0.0:1787841843.156454:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841843.156458:0:9449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b600/0xe3dac0c99afff1a2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841843.156464:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b600/0xe3dac0c99afff1a2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841843.156475:0:9449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a000/0xe3dac0c99afff1a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x56f351e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841843.156480:0:9449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a000/0xe3dac0c99afff1a9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x56f351e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841843.156486:0:9449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a000/0xe3dac0c99afff1a9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x56f351e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841843.156490:0:9449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbffa3a000 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:0.0:1787841843.156501:0:9449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a000/0xe3dac0c99afff1a9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x56f351e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841843.156507:0:9449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a000/0xe3dac0c99afff1a9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x56f351e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841843.156515:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x56f351e7 (ffff92cbc57e3600) 00010000:00010000:0.0:1787841843.156518:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841843.156522:0:9449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a000/0xe3dac0c99afff1a9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x56f351e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841843.156527:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a000/0xe3dac0c99afff1a9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x56f351e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841843.156649:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac11143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+61:11614:x1874687695090048:12345-192.168.201.1@tcp:36:lhsmtool_posix.0 Request processed in 661us (860us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787841843.156658:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 220 00000100:00100000:0.0:1787841843.169191:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841843.169504:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695090176 00000100:00100000:3.0:1787841843.169521:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695090176 00000100:00100000:3.0:1787841843.169655:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 221 00000100:00100000:3.0:1787841843.169677:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cc00cc43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+61:11614:x1874687695090176:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787841843.169751:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841843.169784:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99afff1b0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6b38 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841843.169846:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99afff1b7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841843.169863:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99afff1b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841843.169875:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99afff1b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841843.170753:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99afff1b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b38 expref: 63 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841843.170778:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99afff1b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b38 expref: 62 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841843.170797:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff92cbc89cd100) 00010000:00010000:3.0:1787841843.170800:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787841843.170804:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc149c000, rc 0) 00000100:00100000:3.0:1787841843.170939:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cc00cc43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+62:11614:x1874687695090176:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 Request processed in 1273us (1765us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841843.170947:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 221 00000100:00100000:2.0:1787841843.182032:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841843.182691:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695090432 00000100:00100000:1.0:1787841843.182747:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695090432 00000100:00100000:1.0:1787841843.182837:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 222 00000100:00100000:1.0:1787841843.182851:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6dff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2767a54-6703-4908-8414-eab6601e2ceb+62:11614:x1874687695090432:12345-192.168.201.1@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787841843.183563:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9da00/0xe3dac0c99afff1be lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.183589:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9da00/0xe3dac0c99afff1be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.183606:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9da00/0xe3dac0c99afff1be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787841843.184613:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:1.0:1787841843.184644:0:5838:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 383182945028ns, next at 384182940856ns, rc = 0 00000004:00010000:1.0:1787841843.198750:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007ff4a454 reply state 00000000ca9c3d39 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9da00/0xe3dac0c99afff1be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841843.198808:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787841843.202443:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6dff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2767a54-6703-4908-8414-eab6601e2ceb+64:11614:x1874687695090432:12345-192.168.201.1@tcp:36:lhsmtool_posix.0 Request processed in 19574us (20410us total) trans 4294967505 rc 0/0 00000100:00100000:1.0:1787841843.202462:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 222 00000100:00100000:2.0:1787841843.211597:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841843.211767:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695090560 00000100:00100000:0.0:1787841843.211782:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695090560 00000100:00100000:0.0:1787841843.211850:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 223 00000100:00100000:0.0:1787841843.211862:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6dff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+64:11614:x1874687695090560:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787841843.211897:0:9449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841843.211924:0:9449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b600/0xe3dac0c99afff1c5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6b3f expref: -99 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841843.212016:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b600/0xe3dac0c99afff1c5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b3f expref: 65 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841843.212036:0:9449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b600/0xe3dac0c99afff1c5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b3f expref: 65 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841843.212089:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff92cbc89cd100) 00010000:00010000:0.0:1787841843.212104:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787841843.212110:0:9449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbffa3b600, rc 0) 00000100:00100000:0.0:1787841843.212205:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6dff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+65:11614:x1874687695090560:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 Request processed in 344us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841843.212214:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 223 00010000:00010000:3.0:1787841843.213797:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9da00/0xe3dac0c99afff1be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841843.213816:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9da00/0xe3dac0c99afff1be lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841843.213825:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9da00/0xe3dac0c99afff1be lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841843.213833:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cc00d9da00 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:3.0:1787841843.213838:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9da00/0xe3dac0c99afff1be lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841843.213846:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9da00/0xe3dac0c99afff1be lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841843.213868:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff92cbc89cd100) 00010000:00010000:3.0:1787841843.213871:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787841843.213876:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9da00/0xe3dac0c99afff1be lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841843.213884:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9da00/0xe3dac0c99afff1be lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841843.216742:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841843.216893:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695090688 00000100:00100000:2.0:1787841843.216926:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695090688 00000100:00100000:2.0:1787841843.217022:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 63 00000100:00100000:2.0:1787841843.217036:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cc00cc6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b2767a54-6703-4908-8414-eab6601e2ceb+9:2357:x1874687695090688:12345-192.168.201.1@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1787841843.217577:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787841843.217617:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cc00cc6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b2767a54-6703-4908-8414-eab6601e2ceb+10:2357:x1874687695090688:12345-192.168.201.1@tcp:2:lhsmtool_posix.0 Request processed in 582us (930us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1787841843.217626:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 63 00000100:00100000:2.0:1787841843.224312:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841843.224513:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695090944 00000100:00100000:0.0:1787841843.224527:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695090944 00000100:00100000:0.0:1787841843.224602:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 60 00000100:00100000:0.0:1787841843.224615:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6dfde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b2767a54-6703-4908-8414-eab6601e2ceb+64:11614:x1874687695090944:12345-192.168.201.1@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787841843.225860:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6dfde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b2767a54-6703-4908-8414-eab6601e2ceb+65:11614:x1874687695090944:12345-192.168.201.1@tcp:35:lhsmtool_posix.0 Request processed in 1238us (1624us total) trans 4294967506 rc 0/0 00000100:00100000:0.0:1787841843.225874:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 60 00000100:00100000:3.0:1787841843.235619:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841843.236471:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695091200 00000100:00100000:0.0:1787841843.236488:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695091200 00000100:00100000:0.0:1787841843.236573:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 224 00000100:00100000:0.0:1787841843.236584:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac1116d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+65:11614:x1874687695091200:12345-192.168.201.1@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787841843.236813:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac1116d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+65:11614:x1874687695091200:12345-192.168.201.1@tcp:57:lhsmtool_posix.0 Request processed in 230us (1212us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841843.236822:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 224 00000100:00100000:2.0:1787841843.243483:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841843.243980:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695091328 00000100:00100000:1.0:1787841843.243994:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695091328 00000100:00100000:1.0:1787841843.244076:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 225 00000100:00100000:1.0:1787841843.244088:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6dfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2767a54-6703-4908-8414-eab6601e2ceb+65:11614:x1874687695091328:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787841843.246095:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841843.246144:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99afff1cc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6b46 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.246308:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d800/0xe3dac0c99afff1d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.246328:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d800/0xe3dac0c99afff1d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.246344:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d800/0xe3dac0c99afff1d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787841843.246405:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787841843.246433:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d800/0xe3dac0c99afff1d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.246473:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99afff1cc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b46 expref: 67 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.246510:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d800/0xe3dac0c99afff1d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b46 expref: 66 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.246520:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff92cbc89cd100) 00010000:00010000:1.0:1787841843.246524:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787841843.246528:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cc00d9d800, rc 0) 00000100:00100000:1.0:1787841843.246636:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6dfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2767a54-6703-4908-8414-eab6601e2ceb+66:11614:x1874687695091328:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 Request processed in 2551us (3172us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841843.246646:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 225 00000100:00100000:2.0:1787841843.250310:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841843.251468:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695091456 00000100:00100000:1.0:1787841843.251487:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695091456 00000100:00100000:0.0:1787841843.251605:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 64 00000100:00100000:0.0:1787841843.251616:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6dff0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b2767a54-6703-4908-8414-eab6601e2ceb+10:2357:x1874687695091456:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787841843.251663:0:6686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841843.251689:0:6686:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001facac3f/0xe3dac0c99afff1da lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6b4d expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787841843.251743:0:6686:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a904d33, blocks: 0x1 00010000:00010000:0.0:1787841843.251771:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=383s v=(0 0) 00010000:00010000:0.0:1787841843.251777:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787841843.251789:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001facac3f/0xe3dac0c99afff1da lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b4d expref: 11 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841843.251809:0:6686:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001facac3f/0xe3dac0c99afff1da lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b4d expref: 11 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841843.251822:0:6686:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbffa3be00, rc 0) 00000100:00100000:0.0:1787841843.251898:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6dff0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b2767a54-6703-4908-8414-eab6601e2ceb+11:2357:x1874687695091456:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 Request processed in 284us (1614us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841843.251904:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 64 00000100:00100000:3.0:1787841843.259869:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841843.260888:0:12018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695091712 00000100:00100000:1.0:1787841843.260904:0:12018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695091712 00000100:00100000:1.0:1787841843.261033:0:12018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 226 00000100:00100000:1.0:1787841843.261045:0:12018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac11152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b2767a54-6703-4908-8414-eab6601e2ceb+66:11614:x1874687695091712:12345-192.168.201.1@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787841843.261214:0:12018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac11152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b2767a54-6703-4908-8414-eab6601e2ceb+66:11614:x1874687695091712:12345-192.168.201.1@tcp:57:lhsmtool_posix.0 Request processed in 172us (1535us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841843.261220:0:12018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 226 00000100:00100000:3.0:1787841843.264587:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841843.264668:0:12388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695091840 00000100:00100000:0.0:1787841843.264681:0:12388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695091840 00000100:00100000:0.0:1787841843.264792:0:12388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 65 00000100:00100000:0.0:1787841843.264803:0:12388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac1117c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b2767a54-6703-4908-8414-eab6601e2ceb+11:11614:x1874687695091840:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787841843.264829:0:12388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841843.264853:0:12388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008ca0ea32/0xe3dac0c99afff1e1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6b54 expref: -99 pid: 12388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841843.264893:0:12388:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001facac3f/0xe3dac0c99afff1da lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b4d expref: 12 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841843.264923:0:12388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787841843.264928:0:12388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787841843.264933:0:12388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ca0ea32/0xe3dac0c99afff1e1 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b54 expref: 12 pid: 12388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841843.264981:0:12388:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001facac3f/0xe3dac0c99afff1da lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b4d expref: 12 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841843.264998:0:12388:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001facac3f/0xe3dac0c99afff1da lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b4d expref: 12 pid: 6686 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841843.265016:0:12388:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cc00cc52c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12388:1874687715000576:192.168.201.1@tcp:104: 00000100:00100000:0.0:1787841843.265158:0:12388:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbd1ff9600 going to sleep for 11 seconds 00000100:00100000:2.0:1787841843.268392:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841843.268424:0:12388:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cc00cc52c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12388:1874687715000576:192.168.201.1@tcp:104: 00000100:00100000:3.0:1787841843.268443:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695091968 00000100:00100000:3.0:1787841843.268451:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695091968 00010000:00010000:3.0:1787841843.268504:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001facac3f/0xe3dac0c99afff1da lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b4d expref: 13 pid: 6686 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841843.268522:0:12388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008ca0ea32/0xe3dac0c99afff1e1 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b54 expref: 13 pid: 12388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841843.268544:0:12388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbffa3b000, rc 0) 00000100:00100000:3.0:1787841843.268586:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 81 00000100:00100000:3.0:1787841843.268594:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6dfe940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b2767a54-6703-4908-8414-eab6601e2ceb+13:2357:x1874687695091968:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787841843.268609:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1787841843.268610:0:12388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac1117c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b2767a54-6703-4908-8414-eab6601e2ceb+13:11614:x1874687695091840:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 Request processed in 3809us (4040us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841843.268618:0:12388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 65 00010000:00010000:3.0:1787841843.268635:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001facac3f/0xe3dac0c99afff1da lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b4d expref: 12 pid: 6686 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841843.268649:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001facac3f/0xe3dac0c99afff1da lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b4d expref: 12 pid: 6686 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841843.268676:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001facac3f/0xe3dac0c99afff1da lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b4d expref: 12 pid: 6686 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841843.268689:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787841843.268693:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787841843.268745:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008ca0ea32/0xe3dac0c99afff1e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b54 expref: 11 pid: 12388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841843.268778:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ca0ea32/0xe3dac0c99afff1e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b54 expref: 11 pid: 12388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841843.268853:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000008ca0ea32/0xe3dac0c99afff1e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b54 expref: 11 pid: 12388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841843.268935:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cc00cc52c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5824:1874687715000704:192.168.201.1@tcp:105: 00000100:00100000:0.0:1787841843.269009:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbd1ff9600 going to sleep for 11 seconds 00000100:00100000:0.0:1787841843.272126:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cc00cc52c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5824:1874687715000704:192.168.201.1@tcp:105: 00010000:00010000:0.0:1787841843.272166:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787841843.272648:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6dfe940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b2767a54-6703-4908-8414-eab6601e2ceb+11:2357:x1874687695091968:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 4051us (4264us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841843.272660:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 81 00000100:00100000:3.0:1787841843.274510:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841843.274627:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695092096 00000100:00100000:2.0:1787841843.274641:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695092096 00002000:00100000:2.0:1787841843.274727:0:6693:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff92cac1114780 x1874687695092096/t0(0) o4->b2767a54-6703-4908-8414-eab6601e2ceb@192.168.201.1@tcp:344/0 lens 504/0 e 0 to 0 dl 1787841854 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787841843.274739:0:6693:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff92cac1114780 with x1874687695092096 ext(0->12) 00002000:00010000:2.0:1787841843.274746:0:6693:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92cac1114780 00000100:00100000:2.0:1787841843.274784:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 6 00000100:00100000:2.0:1787841843.274795:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac1114780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b2767a54-6703-4908-8414-eab6601e2ceb+11:2356:x1874687695092096:12345-192.168.201.1@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787841843.275672:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac1114780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b2767a54-6703-4908-8414-eab6601e2ceb+13:2356:x1874687695092096:12345-192.168.201.1@tcp:4:lhsmtool_posix.0 Request processed in 875us (1169us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1787841843.275682:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 6 00002000:00100000:2.0:1787841843.275691:0:6693:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff92cac1114780 x1874687695092096/t4294967320(0) o4->b2767a54-6703-4908-8414-eab6601e2ceb@192.168.201.1@tcp:344/0 lens 504/448 e 0 to 0 dl 1787841854 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787841843.275725:0:6693:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff92cac1114780 with x1874687695092096 ext(0->12) 00002000:00010000:2.0:1787841843.275730:0:6693:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92cac1114780 00000100:00100000:0.0:1787841843.278131:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841843.278246:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695092224 00000100:00100000:3.0:1787841843.278259:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695092224 00000100:00100000:3.0:1787841843.278337:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 227 00000100:00100000:3.0:1787841843.278351:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cc00cc52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+66:11614:x1874687695092224:12345-192.168.201.1@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1787841843.314179:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cc00cc52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+66:11614:x1874687695092224:12345-192.168.201.1@tcp:44:lhsmtool_posix.0 Request processed in 35814us (36044us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841843.314202:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 227 00000001:00080000:3.0:1787841843.314332:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:3.0:1787841843.314389:0:5860:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000004:00080000:3.0:1787841843.314452:0:5860:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:3.0:1787841843.314475:0:5860:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff92cbc2e21b40 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:3.0:1787841843.314481:0:5860:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff92cbe9a9a800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff92cbc2e213c0 00000020:00080000:3.0:1787841843.314484:0:5860:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff92cbe9a9a400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff92cbf6e19400 00000004:00080000:3.0:1787841843.314529:0:5860:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:1.0:1787841843.314726:0:5871:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:1.0:1787841843.314741:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787841843.314764:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6dfcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874687715000832:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787841843.314856:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841843.314956:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cc00cc7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687715000960:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787841843.314991:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841843.315029:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787841843.315035:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cc00cc4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687715001088:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1787841843.315055:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841843.315096:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715000832 00000100:00100000:0.0:1787841843.315104:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715000832 00000100:00100000:0.0:1787841843.315150:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715000960 00000100:00100000:0.0:1787841843.315152:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715000960 00000100:00100000:0.0:1787841843.315167:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715001088 00000100:00100000:0.0:1787841843.315169:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715001088 00000100:00100000:0.0:1787841843.315182:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787841843.315193:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e29e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3300:x1874687715000832:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787841843.315217:0:9572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00002000:00080000:0.0:1787841843.315227:0:6686:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:0.0:1787841843.315268:0:6686:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a904d32, atime: 0x6a904d32, ctime: 0x6a904d32, blocks: 0x1 00010000:00010000:0.0:1787841843.315277:0:6686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e858aba/0xe3dac0c99afff1e8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841843.315299:0:9572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cc00cc5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3298:x1874687715000960:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787841843.315314:0:9572:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:0.0:1787841843.315325:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=383s v=(0 0) 00010000:00010000:0.0:1787841843.315331:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787841843.315333:0:9572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069da2345/0xe3dac0c99afff1ef lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841843.315340:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e858aba/0xe3dac0c99afff1e8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841843.315362:0:6686:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006e858aba/0xe3dac0c99afff1e8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841843.315382:0:6686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e858aba/0xe3dac0c99afff1e8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841843.315390:0:6686:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006e858aba/0xe3dac0c99afff1e8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.315403:0:9572:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000070798621/0xe3dac0c99affefaa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6ab3 expref: 12 pid: 12388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.315412:0:9572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1787841843.315413:0:6686:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787841843.315415:0:9572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787841843.315420:0:9572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069da2345/0xe3dac0c99afff1ef lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.315463:0:9572:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000070798621/0xe3dac0c99affefaa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6ab3 expref: 12 pid: 12388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.315481:0:9572:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000070798621/0xe3dac0c99affefaa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6ab3 expref: 12 pid: 12388 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841843.315496:0:9572:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac2dbcf00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9572:1874687715001216:192.168.201.1@tcp:104: 00000100:00100000:1.0:1787841843.315560:0:9572:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cc01e43a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787841843.316048:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e29e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3300:x1874687715000832:12345-0@lo:6:osp-syn-1-0.0 Request processed in 854us (1192us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1787841843.316057:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787841843.316079:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787841843.316087:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cc00cc5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3298:x1874687715001088:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1787841843.316207:0:6686:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1787841843.316211:0:6686:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1787841843 00002000:00010000:0.0:1787841843.316214:0:6686:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787841843.316216:0:6686:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1787841843 -> 1787841843 00002000:00010000:0.0:1787841843.316218:0:6686:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1787841843.316255:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cc00cc5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3298:x1874687715001088:12345-0@lo:2:osp-syn-0-0.0 Request processed in 170us (1199us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1787841843.316262:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000004:00080000:1.0:1787841843.316281:0:3300:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff92cbf6dfcb40/2, rc 0, transno 4294967310 00000100:00100000:1.0:1787841843.316301:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6dfcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874687715000832:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1787841843.316310:0:3298:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff92cc00cc4780/2, rc 0, transno 4294967321 00000100:00100000:0.0:1787841843.316318:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cc00cc4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687715001088:0@lo:2:osp-syn-0-0.0 00000020:00080000:3.0:1787841843.316830:0:5860:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:1.0:1787841843.316873:0:5871:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:3.0:1787841843.316878:0:5860:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff92cbc6722a80 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1787841843.316883:0:5860:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff92cbc4eb6300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff92cbc6722e40 00000020:00080000:3.0:1787841843.316887:0:5860:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff92cbc4eb6e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff92cbff4d1800 00000020:00080000:1.0:1787841843.316895:0:5871:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00010000:00010000:3.0:1787841843.316919:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787841843.316929:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006e858aba/0xe3dac0c99afff1e8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841843.316941:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbffa3a200 already unused, calling callback (ffffffffc17a4500) 00010000:00010000:3.0:1787841843.316953:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006e858aba/0xe3dac0c99afff1e8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841843.316966:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006e858aba/0xe3dac0c99afff1e8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841843.316991:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006e858aba/0xe3dac0c99afff1e8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787841843.317085:0:5871:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00010000:00010000:3.0:1787841843.318116:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006e858aba/0xe3dac0c99afff1e8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841843.318149:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841843.318152:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841843.318154:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787841843.319202:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841843.319287:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695092352 00000100:00100000:1.0:1787841843.319309:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695092352 00000100:00100000:0.0:1787841843.319450:0:12388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 69 00000100:00100000:0.0:1787841843.319464:0:12388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf8cae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b2767a54-6703-4908-8414-eab6601e2ceb+13:2357:x1874687695092352:12345-192.168.201.1@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1787841843.320906:0:9572:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac2dbcf00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9572:1874687715001216:192.168.201.1@tcp:104: 00010000:00010000:1.0:1787841843.320947:0:9572:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000069da2345/0xe3dac0c99afff1ef lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841843.328239:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841843.328288:0:7633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695092480 00000100:00100000:2.0:1787841843.328312:0:7633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695092480 00010000:00010000:2.0:1787841843.328430:0:7633:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000070798621/0xe3dac0c99affefaa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6ab3 expref: 14 pid: 12388 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841843.328577:0:7633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 82 00000100:00100000:2.0:1787841843.328589:0:7633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6dfe580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b2767a54-6703-4908-8414-eab6601e2ceb+14:2357:x1874687695092480:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787841843.328610:0:7633:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787841843.328616:0:7633:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000070798621/0xe3dac0c99affefaa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6ab3 expref: 14 pid: 12388 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841843.328634:0:7633:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000070798621/0xe3dac0c99affefaa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6ab3 expref: 14 pid: 12388 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841843.328667:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000070798621/0xe3dac0c99affefaa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6ab3 expref: 14 pid: 12388 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841843.328688:0:7633:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787841843.328693:0:7633:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787841843.328733:0:7633:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000069da2345/0xe3dac0c99afff1ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841843.328747:0:7633:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069da2345/0xe3dac0c99afff1ef lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841843.328784:0:7633:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787841843.328868:0:7633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6dfe580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b2767a54-6703-4908-8414-eab6601e2ceb+13:2357:x1874687695092480:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 281us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841843.328877:0:7633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 82 00010000:00010000:1.0:1787841843.332301:0:9572:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000069da2345/0xe3dac0c99afff1ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.332325:0:9572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069da2345/0xe3dac0c99afff1ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.332340:0:9572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069da2345/0xe3dac0c99afff1ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.332350:0:9572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069da2345/0xe3dac0c99afff1ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.332475:0:9572:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787841843.335163:0:9572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cc00cc5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3298:x1874687715000960:12345-0@lo:6:osp-syn-0-0.0 Request processed in 19865us (20157us total) trans 4294967322 rc 0/0 00000100:00100000:1.0:1787841843.335181:0:9572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00010000:1.0:1787841843.335245:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787841843.335256:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069da2345/0xe3dac0c99afff1ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.336164:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cc00d9d600 already unused, calling callback (ffffffffc17a4500) 00010000:00010000:1.0:1787841843.336173:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069da2345/0xe3dac0c99afff1ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.336188:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069da2345/0xe3dac0c99afff1ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.336216:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069da2345/0xe3dac0c99afff1ef lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.336225:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069da2345/0xe3dac0c99afff1ef lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.336253:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841843.336255:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841843.336256:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787841843.337314:0:3298:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff92cc00cc7c00/2, rc 0, transno 4294967322 00000100:00100000:1.0:1787841843.337329:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cc00cc7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687715000960:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787841843.342307:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841843.342372:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841843.342451:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695092608 00000100:00100000:0.0:1787841843.342467:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695092608 00000100:00100000:2.0:1787841843.342740:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841843.342774:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695092736 00000100:00100000:2.0:1787841843.342779:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695092736 00000100:00100000:2.0:1787841843.342841:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 80 00000100:00100000:2.0:1787841843.342852:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6dfed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b2767a54-6703-4908-8414-eab6601e2ceb+7:2354:x1874687695092736:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:2.0:1787841843.342942:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6dfed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b2767a54-6703-4908-8414-eab6601e2ceb+7:2354:x1874687695092736:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 93us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841843.342950:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 80 00000100:00080000:2.0:1787841843.342974:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787841843.343380:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 308 00000100:00100000:0.0:1787841843.343390:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a1f1ce-26b5-4cc6-a1db-8e09063432da+13:2354:x1874687695092608:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:0.0:1787841843.343517:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a1f1ce-26b5-4cc6-a1db-8e09063432da+13:2354:x1874687695092608:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 130us (1237us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841843.343525:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 308 00000100:00100000:1.0:1787841843.344060:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695092864 00000100:00100000:1.0:1787841843.344070:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695092864 00000100:00080000:0.0:1787841843.344469:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787841843.344592:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 176 00000100:00100000:1.0:1787841843.344601:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6dfc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fe7d2185-ae43-428e-8bfa-909f60138853+5:2354:x1874687695092864:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:1.0:1787841843.344743:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6dfc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fe7d2185-ae43-428e-8bfa-909f60138853+5:2354:x1874687695092864:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 141us (2375us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841843.344752:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 176 00000001:00080000:2.0:1787841843.368122:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000001:00080000:2.0:1787841843.368669:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000100:00100000:0.0:1787841843.369452:0:12388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf8cae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b2767a54-6703-4908-8414-eab6601e2ceb+7:2357:x1874687695092352:12345-192.168.201.1@tcp:16:lhsmtool_posix.0 Request processed in 49903us (50297us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841843.369468:0:12388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 69 00000100:00100000:2.0:1787841843.372909:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841843.373201:0:12018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695093120 00000100:00100000:1.0:1787841843.373214:0:12018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695093120 00000100:00100000:1.0:1787841843.373350:0:12018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 228 00000100:00100000:1.0:1787841843.373362:0:12018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6dfd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b2767a54-6703-4908-8414-eab6601e2ceb+20:11614:x1874687695093120:12345-192.168.201.1@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787841843.373459:0:12018:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787841843.373499:0:12018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d800/0xe3dac0c99afff1d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b46 expref: 20 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.373530:0:12018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff92cbc89cd100) 00010000:00010000:1.0:1787841843.373536:0:12018:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787841843.374023:0:12018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99afff1f6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.374038:0:12018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99afff1f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.374053:0:12018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99afff1f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787841843.374942:0:12018:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d8139867 reply state 00000000120debc9 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99afff1f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841843.374959:0:12018:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787841843.375361:0:12018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6dfd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b2767a54-6703-4908-8414-eab6601e2ceb+21:11614:x1874687695093120:12345-192.168.201.1@tcp:36:lhsmtool_posix.0 Request processed in 1997us (2466us total) trans 4294967507 rc 0/0 00000100:00100000:1.0:1787841843.375377:0:12018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 228 00000100:00100000:0.0:1787841843.379670:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841843.379760:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695093248 00000100:00100000:2.0:1787841843.379773:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695093248 00000100:00100000:2.0:1787841843.379845:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 70 00000100:00100000:2.0:1787841843.379854:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cc00cc6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b2767a54-6703-4908-8414-eab6601e2ceb+7:2355:x1874687695093248:12345-192.168.201.1@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787841843.380285:0:6686:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1787841843.380300:0:6686:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1787841843 -> 1787841843 00002000:00010000:2.0:1787841843.380303:0:6686:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1787841842 00002000:00010000:2.0:1787841843.380306:0:6686:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1787841843 -> 1787841843 00002000:00010000:2.0:1787841843.380309:0:6686:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1787841843.380390:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cc00cc6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b2767a54-6703-4908-8414-eab6601e2ceb+8:2355:x1874687695093248:12345-192.168.201.1@tcp:2:lhsmtool_posix.0 Request processed in 536us (736us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1787841843.380417:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 70 00010000:00010000:1.0:1787841843.381203:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99afff1f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.381221:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99afff1f6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.381243:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99afff1f6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.381251:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cc00d9d600 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:1.0:1787841843.381257:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99afff1f6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.381268:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99afff1f6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.381408:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff92cbc89cd100) 00010000:00010000:1.0:1787841843.381412:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787841843.381421:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99afff1f6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.381428:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99afff1f6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841843.386935:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841843.387954:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695093504 00000100:00100000:1.0:1787841843.387972:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695093504 00000100:00100000:2.0:1787841843.388259:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 229 00000100:00100000:2.0:1787841843.388273:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6dff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+20:11614:x1874687695093504:12345-192.168.201.1@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787841843.388403:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104200/0xe3dac0c99afff1fd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841843.388421:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99afff1b7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b38 expref: 20 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841843.388429:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104200/0xe3dac0c99afff1fd lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841843.388479:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99afff1b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b38 expref: 20 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841843.388497:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99afff1b7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b38 expref: 20 pid: 5839 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841843.388515:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbcd5ae1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1874687715001344:192.168.201.1@tcp:104: 00000100:00100000:2.0:1787841843.388876:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc6555240 going to sleep for 11 seconds 00000100:00100000:2.0:1787841843.391676:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbcd5ae1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1874687715001344:192.168.201.1@tcp:104: 00010000:00010000:2.0:1787841843.391751:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104200/0xe3dac0c99afff1fd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841843.393053:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841843.393414:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695093632 00000100:00100000:1.0:1787841843.393427:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695093632 00010000:00010000:1.0:1787841843.393488:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99afff1b7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b38 expref: 21 pid: 5839 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841843.393982:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 83 00000100:00100000:1.0:1787841843.393995:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd5ae1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b2767a54-6703-4908-8414-eab6601e2ceb+21:2356:x1874687695093632:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787841843.394016:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787841843.394026:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99afff1b7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b38 expref: 21 pid: 5839 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.394378:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99afff1b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b38 expref: 21 pid: 5839 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.394406:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99afff1b7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b38 expref: 21 pid: 5839 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.394424:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff92cbc89cd100) 00010000:00010000:1.0:1787841843.394430:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104200/0xe3dac0c99afff1fd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.394523:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104200/0xe3dac0c99afff1fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.394532:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104200/0xe3dac0c99afff1fd lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.394619:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787841843.394742:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104200/0xe3dac0c99afff1fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841843.394752:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104200/0xe3dac0c99afff1fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841843.394793:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104200/0xe3dac0c99afff1fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841843.394798:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104200/0xe3dac0c99afff1fd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841843.394804:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104200/0xe3dac0c99afff1fd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841843.394808:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6104200 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:2.0:1787841843.394812:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104200/0xe3dac0c99afff1fd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841843.394818:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104200/0xe3dac0c99afff1fd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841843.395059:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff92cbc89cd100) 00010000:00010000:2.0:1787841843.395063:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787841843.395068:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104200/0xe3dac0c99afff1fd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841843.395075:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104200/0xe3dac0c99afff1fd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841843.395164:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6dff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+20:11614:x1874687695093504:12345-192.168.201.1@tcp:55:lhsmtool_posix.0 Request processed in 6892us (8243us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787841843.395190:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 229 00000100:00100000:0.0:1787841843.395649:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd5ae1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b2767a54-6703-4908-8414-eab6601e2ceb+19:2356:x1874687695093632:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 1656us (2611us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841843.395664:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 83 00000100:00100000:2.0:1787841843.398027:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841843.398373:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695093760 00000100:00100000:0.0:1787841843.398386:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695093760 00000100:00100000:0.0:1787841843.398521:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 71 00000100:00100000:0.0:1787841843.398598:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cc00dde1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b2767a54-6703-4908-8414-eab6601e2ceb+8:2356:x1874687695093760:12345-192.168.201.1@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787841843.398654:0:6688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006e858aba/0xe3dac0c99afff204 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841843.398677:0:6688:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008ca0ea32/0xe3dac0c99afff1e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b54 expref: 8 pid: 12388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841843.398685:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787841843.398691:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787841843.398695:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e858aba/0xe3dac0c99afff204 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841843.399225:0:6688:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008ca0ea32/0xe3dac0c99afff1e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b54 expref: 8 pid: 12388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841843.399243:0:6688:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008ca0ea32/0xe3dac0c99afff1e1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b54 expref: 8 pid: 12388 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841843.399263:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cc00cc5a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6688:1874687715001472:192.168.201.1@tcp:104: 00000100:00100000:0.0:1787841843.399462:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc83799c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787841843.411047:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841843.411211:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cc00cc5a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6688:1874687715001472:192.168.201.1@tcp:104: 00010000:00010000:0.0:1787841843.411251:0:6688:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006e858aba/0xe3dac0c99afff204 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841843.415100:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695093888 00000100:00100000:1.0:1787841843.415125:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695093888 00010000:00010000:1.0:1787841843.415199:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008ca0ea32/0xe3dac0c99afff1e1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b54 expref: 9 pid: 12388 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841843.415330:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 84 00000100:00100000:1.0:1787841843.415345:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cc00ddda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b2767a54-6703-4908-8414-eab6601e2ceb+9:2356:x1874687695093888:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787841843.415372:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787841843.415406:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008ca0ea32/0xe3dac0c99afff1e1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b54 expref: 9 pid: 12388 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.415473:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008ca0ea32/0xe3dac0c99afff1e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b54 expref: 9 pid: 12388 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.415504:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ca0ea32/0xe3dac0c99afff1e1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b54 expref: 9 pid: 12388 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.415523:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787841843.415527:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787841843.415532:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006e858aba/0xe3dac0c99afff204 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.415541:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e858aba/0xe3dac0c99afff204 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.415583:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787841843.417217:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cc00ddda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b2767a54-6703-4908-8414-eab6601e2ceb+8:2356:x1874687695093888:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 1861us (6219us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841843.417236:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 84 00010000:00010000:0.0:1787841843.417377:0:6688:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006e858aba/0xe3dac0c99afff204 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841843.417419:0:6688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e858aba/0xe3dac0c99afff204 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841843.417469:0:6688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006e858aba/0xe3dac0c99afff204 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841843.417480:0:6688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006e858aba/0xe3dac0c99afff204 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841843.417490:0:6688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006e858aba/0xe3dac0c99afff204 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841843.417497:0:6688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbffa3a200 already unused, calling callback (ffffffffc17a4500) 00010000:00010000:0.0:1787841843.417501:0:6688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006e858aba/0xe3dac0c99afff204 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841843.417509:0:6688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006e858aba/0xe3dac0c99afff204 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841843.417528:0:6688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006e858aba/0xe3dac0c99afff204 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841843.417534:0:6688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e858aba/0xe3dac0c99afff204 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841843.417672:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cc00dde1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b2767a54-6703-4908-8414-eab6601e2ceb+7:2356:x1874687695093760:12345-192.168.201.1@tcp:1:lhsmtool_posix.0 Request processed in 19078us (19655us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841843.417679:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 71 00000100:00100000:3.0:1787841843.426784:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841843.426924:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695094144 00000100:00100000:1.0:1787841843.426936:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695094144 00000100:00100000:1.0:1787841843.427045:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 230 00000100:00100000:1.0:1787841843.427058:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac1117480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+19:11614:x1874687695094144:12345-192.168.201.1@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787841843.427174:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99afff20b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.427193:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99afff20b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.427224:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99afff20b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.427534:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d800/0xe3dac0c99afff212 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.427559:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b600/0xe3dac0c99afff1c5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b3f expref: 20 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.427570:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d800/0xe3dac0c99afff212 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.427609:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b600/0xe3dac0c99afff1c5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b3f expref: 20 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.427621:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b600/0xe3dac0c99afff1c5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b3f expref: 20 pid: 9449 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841843.427635:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac2dbcf00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1874687715001600:192.168.201.1@tcp:104: 00000100:00100000:1.0:1787841843.427762:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbd1ff9b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787841843.432796:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac2dbcf00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1874687715001600:192.168.201.1@tcp:104: 00010000:00010000:1.0:1787841843.432834:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d800/0xe3dac0c99afff212 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841843.433884:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841843.434438:0:7633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695094272 00000100:00100000:2.0:1787841843.434452:0:7633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695094272 00010000:00010000:2.0:1787841843.434510:0:7633:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b600/0xe3dac0c99afff1c5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b3f expref: 21 pid: 9449 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841843.434552:0:7633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 85 00000100:00100000:2.0:1787841843.434562:0:7633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac1117c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b2767a54-6703-4908-8414-eab6601e2ceb+21:2357:x1874687695094272:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787841843.434586:0:7633:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787841843.434593:0:7633:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b600/0xe3dac0c99afff1c5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b3f expref: 21 pid: 9449 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841843.434611:0:7633:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b600/0xe3dac0c99afff1c5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b3f expref: 21 pid: 9449 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841843.434651:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b600/0xe3dac0c99afff1c5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b3f expref: 21 pid: 9449 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841843.434674:0:7633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff92cbc89cd100) 00010000:00010000:2.0:1787841843.434679:0:7633:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d800/0xe3dac0c99afff212 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841843.434693:0:7633:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d800/0xe3dac0c99afff212 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841843.435125:0:7633:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d800/0xe3dac0c99afff212 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841843.435286:0:7633:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787841843.435390:0:7633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac1117c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b2767a54-6703-4908-8414-eab6601e2ceb+20:2357:x1874687695094272:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 828us (1511us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841843.435401:0:7633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 85 00010000:00010000:1.0:1787841843.437544:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d800/0xe3dac0c99afff212 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.437568:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d800/0xe3dac0c99afff212 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787841843.439629:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:0.0:1787841843.439897:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:0.0:1787841843.439944:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:0.0:1787841843.440070:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cc00cc5a40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5837:1874687715001728:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787841843.440589:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841843.440716:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbd14e3f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787841843.440823:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715001728 00000100:00100000:2.0:1787841843.440833:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715001728 00000100:00100000:2.0:1787841843.440999:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787841843.441013:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cc00cc5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5837:x1874687715001728:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787841843.441137:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cc00cc5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5837:x1874687715001728:12345-0@lo:1000:mdt00_000.0 Request processed in 127us (964us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841843.441147:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787841843.441220:0:5837:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:0.0:1787841843.441229:0:5837:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:0.0:1787841843.441261:0:5837:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff92cc00cc4780, transno 4294967321 00000100:00100000:0.0:1787841843.441297:0:5837:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff92cc00cc7c00 x1874687715000960/t4294967322(4294967322) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787841859 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787841843.441312:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cc00cc5a40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5837:1874687715001728:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1787841843.441894:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:0.0:1787841843.441984:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cc00cc5a40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5837:1874687715001856:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787841843.442031:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841843.442677:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbcdb29240 going to sleep for 11 seconds 00000100:00100000:3.0:1787841843.442743:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715001856 00000100:00100000:3.0:1787841843.442751:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715001856 00000100:00100000:3.0:1787841843.442795:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787841843.442803:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cc00cc61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5837:x1874687715001856:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787841843.443556:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cc00cc61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5837:x1874687715001856:12345-0@lo:1000:mdt00_000.0 Request processed in 749us (1519us total) trans 4294967324 rc 0/0 00000100:00100000:3.0:1787841843.443566:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787841843.443676:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cc00cc5a40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5837:1874687715001856:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1787841843.443748:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d800/0xe3dac0c99afff212 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.443760:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d800/0xe3dac0c99afff212 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.443768:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d800/0xe3dac0c99afff212 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.443775:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cc00d9d800 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:1.0:1787841843.443780:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d800/0xe3dac0c99afff212 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.443790:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d800/0xe3dac0c99afff212 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.443809:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff92cbc89cd100) 00010000:00010000:1.0:1787841843.443812:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787841843.443818:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d800/0xe3dac0c99afff212 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.443824:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d800/0xe3dac0c99afff212 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.443875:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99afff155 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.443882:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99afff155 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.443910:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99afff155 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.443915:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cc00d9de00 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:1.0:1787841843.443918:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99afff155 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.443924:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99afff155 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.443932:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92cbc89cd700) 00010000:00010000:1.0:1787841843.443934:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787841843.443943:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3aa00/0xe3dac0c99afff15c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b23 expref: 23 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.443956:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3aa00/0xe3dac0c99afff15c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b23 expref: 23 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.443967:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3aa00/0xe3dac0c99afff15c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b23 expref: 23 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.444004:0:5837:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3aa00/0xe3dac0c99afff15c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b23 expref: 23 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841843.444020:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac2dbcf00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1874687715001984:192.168.201.1@tcp:105: 00000100:00100000:1.0:1787841843.445590:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbd1ff9900 going to sleep for 11 seconds 00000100:00100000:3.0:1787841843.448092:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841843.448207:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac2dbcf00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1874687715001984:192.168.201.1@tcp:105: 00000100:00100000:2.0:1787841843.448278:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695094400 00010000:00010000:1.0:1787841843.448279:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99afff155 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841843.448303:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695094400 00010000:00010000:1.0:1787841843.448303:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99afff155 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.448347:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9ca00/0xe3dac0c99afff219 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841843.448388:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 61 00000100:00100000:2.0:1787841843.448400:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac1117840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b2767a54-6703-4908-8414-eab6601e2ceb+24:11613:x1874687695094400:12345-192.168.201.1@tcp:49:lfs.0 00010000:00010000:1.0:1787841843.448515:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9ca00/0xe3dac0c99afff219 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.448532:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9ca00/0xe3dac0c99afff219 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.448543:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9ca00/0xe3dac0c99afff219 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.448550:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9ca00/0xe3dac0c99afff219 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.448557:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9ca00/0xe3dac0c99afff219 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.448563:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cc00d9ca00 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:1.0:1787841843.448568:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9ca00/0xe3dac0c99afff219 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.448576:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9ca00/0xe3dac0c99afff219 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.448590:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92cbc89cd700) 00010000:00010000:1.0:1787841843.448592:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787841843.448603:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9ca00/0xe3dac0c99afff219 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.448610:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9ca00/0xe3dac0c99afff219 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.448621:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99afff20b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.448628:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99afff20b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.448634:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99afff20b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.448639:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cc00d9d600 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:1.0:1787841843.448641:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99afff20b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.448646:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99afff20b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.448653:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92cbc89cd700) 00010000:00010000:1.0:1787841843.448656:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787841843.448659:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99afff20b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841843.448665:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99afff20b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841843.448729:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac1117840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b2767a54-6703-4908-8414-eab6601e2ceb+24:11613:x1874687695094400:12345-192.168.201.1@tcp:49:lfs.0 Request processed in 296us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841843.448753:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 61 00000040:00080000:1.0:1787841843.450101:0:11682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787841843.450111:0:11682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787841843.450763:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1787841843.450789:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787841843.451018:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac1117480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+23:11614:x1874687695094144:12345-192.168.201.1@tcp:57:lhsmtool_posix.0 Request processed in 22799us (23084us total) trans 4294967512 rc 0/0 00000100:00100000:3.0:1787841843.451045:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 230 00000020:00080000:3.0:1787841843.451054:0:5837:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1787841843.453341:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841843.455950:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841843.456105:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695094656 00000100:00100000:0.0:1787841843.456122:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695094656 00000100:00100000:0.0:1787841843.456194:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 62 00000100:00100000:0.0:1787841843.456205:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbc73ed850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b2767a54-6703-4908-8414-eab6601e2ceb+23:11614:x1874687695094656:12345-192.168.201.1@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787841843.457407:0:5841:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787841843.457567:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:0.0:1787841843.457688:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b400/0xe3dac0c99afff220 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841843.457733:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b400/0xe3dac0c99afff220 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841843.457746:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b400/0xe3dac0c99afff220 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841843.457756:0:5841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b400/0xe3dac0c99afff220 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841843.457762:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b400/0xe3dac0c99afff220 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841843.457771:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b400/0xe3dac0c99afff220 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841843.457799:0:5841:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787841843.457835:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787841843.457850:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b400/0xe3dac0c99afff220 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841843.457862:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbffa3b400 already unused, calling callback (ffffffffc17a4500) 00010000:00010000:3.0:1787841843.457875:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b400/0xe3dac0c99afff220 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841843.457888:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b400/0xe3dac0c99afff220 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841843.457909:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff92cbc57e3600) 00010000:00010000:3.0:1787841843.457913:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787841843.457919:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b400/0xe3dac0c99afff220 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841843.457926:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b400/0xe3dac0c99afff220 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841843.457950:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841843.457952:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841843.457953:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787841843.458455:0:12018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695094912 00000100:00100000:1.0:1787841843.458477:0:12018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695094912 00000100:00100000:1.0:1787841843.458676:0:12018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 231 00000100:00100000:1.0:1787841843.458689:0:12018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac1114b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b2767a54-6703-4908-8414-eab6601e2ceb+26:11613:x1874687695094912:12345-192.168.201.1@tcp:58:lfs.0 00000100:00100000:0.0:1787841843.458853:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbc73ed850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b2767a54-6703-4908-8414-eab6601e2ceb+26:11614:x1874687695094656:12345-192.168.201.1@tcp:35:lhsmtool_posix.0 Request processed in 2642us (5516us total) trans 4294967514 rc 0/0 00000100:00100000:0.0:1787841843.458867:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 62 00000020:00080000:0.0:1787841843.458873:0:5841:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:1.0:1787841843.459031:0:12018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:1.0:1787841843.459121:0:12018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac1114b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b2767a54-6703-4908-8414-eab6601e2ceb+25:11613:x1874687695094912:12345-192.168.201.1@tcp:58:lfs.0 Request processed in 435us (3183us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841843.459129:0:12018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 231 00000100:00100000:3.0:1787841843.502583:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841843.502742:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695095040 00000100:00100000:2.0:1787841843.502755:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695095040 00000100:00100000:2.0:1787841843.502889:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 232 00000100:00100000:2.0:1787841843.502901:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac1116940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+25:11616:x1874687695095040:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:2.0:1787841843.502936:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841843.502979:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105400/0xe3dac0c99afff227 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6b5b expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841843.503059:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104000/0xe3dac0c99afff22e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841843.503086:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104000/0xe3dac0c99afff22e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841843.503100:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104000/0xe3dac0c99afff22e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841843.503116:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105000/0xe3dac0c99afff235 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841843.503124:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105000/0xe3dac0c99afff235 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841843.503131:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105000/0xe3dac0c99afff235 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841843.503473:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105a00/0xe3dac0c99afff23c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841843.503485:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a800/0xe3dac0c99afff147 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b1c expref: 26 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841843.503494:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105a00/0xe3dac0c99afff23c lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841843.503537:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a800/0xe3dac0c99afff147 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b1c expref: 26 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841843.503563:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a800/0xe3dac0c99afff147 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b1c expref: 26 pid: 5837 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841843.503579:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff42e940 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1874687715002112:192.168.201.1@tcp:104: 00000100:00100000:2.0:1787841843.503686:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc6555240 going to sleep for 11 seconds 00000100:00100000:3.0:1787841843.505768:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff42e940 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1874687715002112:192.168.201.1@tcp:104: 00010000:00010000:3.0:1787841843.505809:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105a00/0xe3dac0c99afff23c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841843.506417:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841843.506501:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695095296 00000100:00100000:1.0:1787841843.506512:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695095296 00000100:00100000:1.0:1787841843.506575:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 63 00000100:00100000:1.0:1787841843.506585:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac1114f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b2767a54-6703-4908-8414-eab6601e2ceb+27:5605:x1874687695095296:12345-192.168.201.1@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787841843.506912:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac1114f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b2767a54-6703-4908-8414-eab6601e2ceb+28:5605:x1874687695095296:12345-192.168.201.1@tcp:35:ldlm_bl.0 Request processed in 327us (497us total) trans 4294967515 rc 0/0 00000100:00100000:1.0:1787841843.506920:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 63 00000100:00100000:2.0:1787841843.508802:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841843.509036:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695095424 00000100:00100000:0.0:1787841843.509048:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695095424 00010000:00010000:0.0:1787841843.509107:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a800/0xe3dac0c99afff147 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b1c expref: 28 pid: 5837 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841843.509148:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 86 00000100:00100000:0.0:1787841843.509157:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff42f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b2767a54-6703-4908-8414-eab6601e2ceb+28:2357:x1874687695095424:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787841843.509177:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787841843.509202:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a800/0xe3dac0c99afff147 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b1c expref: 28 pid: 5837 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841843.509218:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a800/0xe3dac0c99afff147 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b1c expref: 28 pid: 5837 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841843.509246:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a800/0xe3dac0c99afff147 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b1c expref: 28 pid: 5837 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841843.509265:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92cbc89cd700) 00010000:00010000:0.0:1787841843.509272:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105a00/0xe3dac0c99afff23c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841843.509283:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105a00/0xe3dac0c99afff23c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841843.509305:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105a00/0xe3dac0c99afff23c lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841843.509342:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787841843.509414:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff42f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b2767a54-6703-4908-8414-eab6601e2ceb+27:2357:x1874687695095424:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 258us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841843.509422:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 86 00010000:00010000:2.0:1787841843.509578:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105a00/0xe3dac0c99afff23c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841843.509587:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105a00/0xe3dac0c99afff23c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787841843.509645:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787841843.509651:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787841843.509674:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105a00/0xe3dac0c99afff23c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841843.509687:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105a00/0xe3dac0c99afff23c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841843.509829:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104000/0xe3dac0c99afff22e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841843.509838:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104000/0xe3dac0c99afff22e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841843.509846:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104000/0xe3dac0c99afff22e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841843.509852:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6104000 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:2.0:1787841843.509865:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104000/0xe3dac0c99afff22e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841843.509874:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104000/0xe3dac0c99afff22e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841843.509884:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92cbc57e3e00) 00010000:00010000:2.0:1787841843.509888:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787841843.509892:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104000/0xe3dac0c99afff22e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841843.509899:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104000/0xe3dac0c99afff22e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841843.509911:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105000/0xe3dac0c99afff235 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841843.509917:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105000/0xe3dac0c99afff235 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841843.509922:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105000/0xe3dac0c99afff235 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841843.509928:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6105000 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:2.0:1787841843.509931:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105000/0xe3dac0c99afff235 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841843.509936:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105000/0xe3dac0c99afff235 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841843.509943:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff92cbc3b04000) 00010000:00010000:2.0:1787841843.509945:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787841843.509952:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105000/0xe3dac0c99afff235 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841843.509958:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105000/0xe3dac0c99afff235 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841843.509998:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105400/0xe3dac0c99afff227 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b5b expref: 27 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841843.510012:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105a00/0xe3dac0c99afff23c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b5b expref: 26 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841843.510020:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92cbc89cd700) 00010000:00010000:2.0:1787841843.510023:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787841843.510025:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc6105a00, rc 0) 00000100:00100000:2.0:1787841843.510055:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac1116940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+26:11616:x1874687695095040:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 7158us (7491us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841843.510062:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 232 00010000:00010000:3.0:1787841843.778057:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787841844.113125:0:12467:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787841844.113136:0:12467:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787841844.113263:0:12467:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1787841844.113270:0:12467:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1787841844.481609:0:11682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787841844.481626:0:11682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787841844.481675:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1787841844.481683:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787841844.481895:0:11682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac2dbcf00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11682:1874687715002240:192.168.201.1@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787841844.482040:0:11682:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbd1ff9a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787841844.486819:0:11682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac2dbcf00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11682:1874687715002240:192.168.201.1@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787841844.488844:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841844.490871:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695095552 00000100:00100000:3.0:1787841844.490890:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695095552 00000100:00100000:3.0:1787841844.491059:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 233 00000100:00100000:3.0:1787841844.491071:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac2dbcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+26:11629:x1874687695095552:12345-192.168.201.1@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787841844.491127:0:5837:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787841844.491327:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac2dbcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+26:11629:x1874687695095552:12345-192.168.201.1@tcp:53:lhsmtool_posix.0 Request processed in 257us (2494us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841844.491337:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 233 00000100:00100000:2.0:1787841844.502050:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841844.502345:0:12018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695095808 00000100:00100000:1.0:1787841844.502367:0:12018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695095808 00000100:00100000:1.0:1787841844.502470:0:12018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 234 00000100:00100000:1.0:1787841844.502637:0:12018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff42e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b2767a54-6703-4908-8414-eab6601e2ceb+26:11629:x1874687695095808:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787841844.502668:0:12018:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841844.502717:0:12018:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d800/0xe3dac0c99afff243 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6b62 expref: -99 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841844.502878:0:12018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99afff24a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841844.502898:0:12018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99afff24a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841844.502915:0:12018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99afff24a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12018 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787841844.502929:0:12018:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1787841844.503263:0:12018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d800/0xe3dac0c99afff243 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b62 expref: 29 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841844.503296:0:12018:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99afff24a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b62 expref: 28 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841844.503306:0:12018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92cbc89cd700) 00010000:00010000:1.0:1787841844.503310:0:12018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787841844.503314:0:12018:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cc00d9de00, rc 0) 00000100:00100000:1.0:1787841844.503599:0:12018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff42e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b2767a54-6703-4908-8414-eab6601e2ceb+28:11629:x1874687695095808:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 Request processed in 966us (1574us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1787841844.517721:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841844.517956:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695095936 00000100:00100000:0.0:1787841844.517972:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695095936 00000100:00100000:0.0:1787841844.518086:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 17 00000100:00100000:0.0:1787841844.518099:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcdb78050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b2767a54-6703-4908-8414-eab6601e2ceb+29:2356:x1874687695095936:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787841844.518121:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787841844.518159:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99afff24a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b62 expref: 29 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841844.518207:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92cbc89cd700) 00010000:00010000:0.0:1787841844.518214:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787841844.518302:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcdb78050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b2767a54-6703-4908-8414-eab6601e2ceb+28:2356:x1874687695095936:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 205us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841844.518311:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 17 00000100:00100000:1.0:1787841844.519830:0:12018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 234 00000100:00100000:3.0:1787841844.527965:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841844.528314:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695096192 00000100:00100000:2.0:1787841844.528328:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695096192 00000100:00100000:2.0:1787841844.528411:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 235 00000100:00100000:2.0:1787841844.528423:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac1115680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+27:11629:x1874687695096192:12345-192.168.201.1@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787841844.528549:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105200/0xe3dac0c99afff258 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841844.528572:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105200/0xe3dac0c99afff258 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841844.528612:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105200/0xe3dac0c99afff258 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841844.528937:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105200/0xe3dac0c99afff258 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841844.528945:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105200/0xe3dac0c99afff258 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841844.528953:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105200/0xe3dac0c99afff258 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841844.528959:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6105200 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:2.0:1787841844.528965:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105200/0xe3dac0c99afff258 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841844.528974:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105200/0xe3dac0c99afff258 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841844.528989:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92cbc89cd700) 00010000:00010000:2.0:1787841844.528993:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787841844.529000:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105200/0xe3dac0c99afff258 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841844.529007:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105200/0xe3dac0c99afff258 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841844.529826:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac1115680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+28:11629:x1874687695096192:12345-192.168.201.1@tcp:57:lhsmtool_posix.0 Request processed in 1400us (1874us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1787841844.529836:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 235 00000040:00080000:1.0:1787841844.531418:0:11682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787841844.531443:0:11682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787841844.532300:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1787841844.532313:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787841844.536367:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841844.536461:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695096448 00000100:00100000:0.0:1787841844.536487:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695096448 00000100:00100000:0.0:1787841844.536576:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 64 00000100:00100000:0.0:1787841844.536589:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff42f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b2767a54-6703-4908-8414-eab6601e2ceb+28:11629:x1874687695096448:12345-192.168.201.1@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787841844.537025:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff42f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b2767a54-6703-4908-8414-eab6601e2ceb+29:11629:x1874687695096448:12345-192.168.201.1@tcp:35:lhsmtool_posix.0 Request processed in 437us (680us total) trans 4294967518 rc 0/0 00000100:00100000:0.0:1787841844.537034:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 64 00010000:00010000:3.0:1787841844.800908:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787841845.052356:0:7643:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:1.0:1787841845.052601:0:7643:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00010000:00010000:2.0:1787841845.825672:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787841846.437877:0:12521:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787841846.437895:0:12521:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787841846.438078:0:12521:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1787841846.438087:0:12521:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787841846.540638:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cc00cc6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874687715002368:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787841846.540845:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841846.541004:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715002368 00000100:00100000:0.0:1787841846.541026:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715002368 00000100:00100000:0.0:1787841846.541119:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787841846.541129:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cc00cc5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874687715002368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787841846.541177:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787841846.541249:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cc00cc5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874687715002368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841846.541257:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:0.0:1787841846.541289:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787841846.541322:0:3300:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1787841846.541363:0:3300:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff92cbf6df4000, transno 4294967307 00000004:00080000:0.0:1787841846.541376:0:3300:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:0.0:1787841846.541400:0:3300:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff92cbf6dfcb40, transno 4294967310 00000100:00100000:0.0:1787841846.541422:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cc00cc6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874687715002368:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787841846.547445:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac30e52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874687715002624:0@lo:400:kworker.0 00000100:00100000:1.0:1787841846.547561:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841846.547627:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787841846.547634:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac30e4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1874687715002752:0@lo:400:kworker.0 00000100:00100000:1.0:1787841846.547660:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841846.547729:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715002624 00000100:00100000:1.0:1787841846.547738:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715002624 00000100:00100000:1.0:1787841846.547796:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715002752 00000100:00100000:1.0:1787841846.547800:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715002752 00000100:00100000:1.0:1787841846.547836:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1787841846.547847:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac30e4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874687715002624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841846.547912:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac30e4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874687715002624:12345-0@lo:400:kworker.0 Request processed in 66us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841846.547920:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1787841846.547941:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1787841846.547948:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac30e6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1874687715002752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841846.547973:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac30e6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1874687715002752:12345-0@lo:400:kworker.0 Request processed in 26us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841846.547979:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00080000:1.0:1787841846.548025:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787841846.548063:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac30e4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1874687715002752:0@lo:400:kworker.0 00000100:00100000:1.0:1787841846.548075:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac30e52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874687715002624:0@lo:400:kworker.0 00000100:00100000:1.0:1787841846.548100:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac30e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874687715002880:0@lo:400:kworker.0 00000100:00100000:1.0:1787841846.548131:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841846.548151:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787841846.548157:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac2dbed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3300:1874687715002496:0@lo:400:kworker.0 00000100:00100000:1.0:1787841846.548186:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841846.548215:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac30e6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1874687715003008:0@lo:400:kworker.0 00000100:00100000:1.0:1787841846.548236:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841846.548281:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715002496 00000100:00100000:1.0:1787841846.548285:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715002496 00000100:00100000:1.0:1787841846.548313:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:1.0:1787841846.548320:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:3300:x1874687715002496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841846.548354:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:3300:x1874687715002496:12345-0@lo:400:kworker.0 Request processed in 34us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841846.548361:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:1.0:1787841846.548388:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715003008 00000100:00100000:1.0:1787841846.548391:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715003008 00000100:00100000:1.0:1787841846.548416:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1787841846.548422:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac30e4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874687715003008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841846.548452:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac30e4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874687715003008:12345-0@lo:400:kworker.0 Request processed in 30us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841846.548458:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00080000:1.0:1787841846.548474:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787841846.548491:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac2dbed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3300:1874687715002496:0@lo:400:kworker.0 00000100:00100000:1.0:1787841846.548510:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac30e6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1874687715003008:0@lo:400:kworker.0 00000100:00100000:0.0:1787841846.548716:0:12388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715002880 00000100:00100000:0.0:1787841846.548731:0:12388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715002880 00000100:00100000:0.0:1787841846.548782:0:12388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00080000:1.0:1787841846.548785:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787841846.548809:0:12388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac30e52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3300:x1874687715002880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841846.548877:0:12388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac30e52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3300:x1874687715002880:12345-0@lo:400:kworker.0 Request processed in 55us (730us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841846.548884:0:12388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787841846.553056:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac30e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874687715002880:0@lo:400:kworker.0 00000100:00100000:2.0:1787841846.684457:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841846.684565:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695096704 00000100:00100000:0.0:1787841846.684579:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695096704 00000100:00100000:0.0:1787841846.684742:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 236 00000100:00100000:0.0:1787841846.684781:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff42ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+29:11649:x1874687695096704:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:0.0:1787841846.684821:0:9449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841846.684852:0:9449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a400/0xe3dac0c99afff25f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6b69 expref: -99 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841846.685004:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99afff266 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841846.685468:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99afff266 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841846.685518:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99afff266 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787841846.685535:0:9449:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1787841846.685903:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3a400/0xe3dac0c99afff25f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b69 expref: 32 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841846.686294:0:9449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99afff266 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b69 expref: 31 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841846.686305:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92cbc89cd700) 00010000:00010000:0.0:1787841846.686309:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787841846.686313:0:9449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbffa3be00, rc 0) 00000100:00100000:0.0:1787841846.686411:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff42ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+31:11649:x1874687695096704:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 1659us (1968us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1787841846.686441:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 236 00000100:00080000:2.0:1787841846.686577:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787841846.689477:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841846.691002:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695096832 00000100:00100000:1.0:1787841846.691019:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695096832 00000100:00100000:1.0:1787841846.691101:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 237 00000100:00100000:1.0:1787841846.691113:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac1117c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2767a54-6703-4908-8414-eab6601e2ceb+31:11649:x1874687695096832:12345-192.168.201.1@tcp:54:lfs.0 00010000:00010000:1.0:1787841846.691209:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99afff274 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841846.691231:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99afff274 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841846.691256:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99afff274 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841846.691290:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99afff274 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841846.691298:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99afff274 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841846.691304:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99afff274 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841846.691311:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cc00d9d400 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:1.0:1787841846.691315:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99afff274 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841846.691323:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99afff274 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841846.691345:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92cbc89cd700) 00010000:00010000:1.0:1787841846.691348:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787841846.691354:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99afff274 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841846.691360:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d400/0xe3dac0c99afff274 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841846.691469:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac1117c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2767a54-6703-4908-8414-eab6601e2ceb+31:11649:x1874687695096832:12345-192.168.201.1@tcp:54:lfs.0 Request processed in 358us (2002us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841846.691478:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 237 00010000:00010000:3.0:1787841846.851314:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787841846.867936:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841846.868046:0:9572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695096960 00000100:00100000:3.0:1787841846.868061:0:9572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695096960 00000100:00100000:3.0:1787841846.868160:0:9572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 72 00000100:00100000:3.0:1787841846.868172:0:9572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf04c0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b2767a54-6703-4908-8414-eab6601e2ceb+7:2356:x1874687695096960:12345-192.168.201.1@tcp:101:cat.0 00010000:00010000:3.0:1787841846.868199:0:9572:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841846.868229:0:9572:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ef39c8ac/0xe3dac0c99afff27b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6b70 expref: -99 pid: 9572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787841846.868316:0:9572:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a904d33, atime: 0x6a904d32, ctime: 0x6a904d33, blocks: 0xb 00010000:00010000:3.0:1787841846.868343:0:9572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=386s v=(0 0) 00010000:00010000:3.0:1787841846.868349:0:9572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787841846.868360:0:9572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ef39c8ac/0xe3dac0c99afff27b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b70 expref: 8 pid: 9572 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841846.868381:0:9572:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ef39c8ac/0xe3dac0c99afff27b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b70 expref: 8 pid: 9572 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841846.868397:0:9572:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc149c400, rc 0) 00000100:00100000:3.0:1787841846.868492:0:9572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf04c0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b2767a54-6703-4908-8414-eab6601e2ceb+8:2356:x1874687695096960:12345-192.168.201.1@tcp:101:cat.0 Request processed in 322us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841846.868501:0:9572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 72 00000100:00080000:2.0:1787841846.869139:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787841846.881117:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841846.881352:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695097088 00000100:00100000:0.0:1787841846.881367:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695097088 00002000:00100000:0.0:1787841846.881437:0:6692:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff92cbd4a9f0c0 x1874687695097088/t0(0) o3->b2767a54-6703-4908-8414-eab6601e2ceb@192.168.201.1@tcp:347/0 lens 488/0 e 0 to 0 dl 1787841857 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787841846.881451:0:6692:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff92cbd4a9f0c0 with x1874687695097088 ext(0->4095) 00002000:00010000:0.0:1787841846.881458:0:6692:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92cbd4a9f0c0 00000100:00100000:0.0:1787841846.881509:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 7 00000100:00100000:0.0:1787841846.881521:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbd4a9f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b2767a54-6703-4908-8414-eab6601e2ceb+8:2354:x1874687695097088:12345-192.168.201.1@tcp:3:cat.0 00000100:00100000:0.0:1787841846.881846:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbd4a9f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b2767a54-6703-4908-8414-eab6601e2ceb+8:2354:x1874687695097088:12345-192.168.201.1@tcp:3:cat.0 Request processed in 326us (743us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787841846.881854:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 7 00002000:00100000:0.0:1787841846.881862:0:6692:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff92cbd4a9f0c0 x1874687695097088/t0(0) o3->b2767a54-6703-4908-8414-eab6601e2ceb@192.168.201.1@tcp:347/0 lens 488/4536 e 0 to 0 dl 1787841857 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787841846.881870:0:6692:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff92cbd4a9f0c0 with x1874687695097088 ext(0->4095) 00002000:00010000:0.0:1787841846.881891:0:6692:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92cbd4a9f0c0 00000100:00100000:1.0:1787841847.553294:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6ca4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687715003136:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787841847.553416:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841847.553793:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715003136 00000100:00100000:0.0:1787841847.553806:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715003136 00000100:00100000:0.0:1787841847.553884:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787841847.553898:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac30e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3298:x1874687715003136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787841847.553952:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787841847.554017:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac30e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3298:x1874687715003136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841847.554025:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787841847.554611:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6ca4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687715003136:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1787841847.617617:0:11682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787841847.617633:0:11682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787841847.617678:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1787841847.617688:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787841847.875270:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787841848.464546:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841848.464608:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841848.464645:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841848.464673:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841848.464750:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841848.464795:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695097472 00000100:00100000:3.0:1787841848.464811:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695097472 00000100:00100000:3.0:1787841848.464910:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695097600 00000100:00100000:3.0:1787841848.464914:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695097600 00000100:00100000:3.0:1787841848.464944:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 82 00000100:00100000:3.0:1787841848.464957:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac1117840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b2767a54-6703-4908-8414-eab6601e2ceb+8:2355:x1874687695097472:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:3.0:1787841848.465077:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac1117840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b2767a54-6703-4908-8414-eab6601e2ceb+8:2355:x1874687695097472:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 122us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841848.465103:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 82 00000100:00100000:3.0:1787841848.465127:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 83 00000100:00100000:3.0:1787841848.465134:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6df61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b2767a54-6703-4908-8414-eab6601e2ceb+5:2355:x1874687695097600:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:3.0:1787841848.465161:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6df61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b2767a54-6703-4908-8414-eab6601e2ceb+5:2355:x1874687695097600:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 28us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841848.465167:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 83 00000100:00100000:3.0:1787841848.465187:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695097728 00000100:00100000:3.0:1787841848.465191:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695097728 00000100:00100000:3.0:1787841848.465232:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695097344 00000100:00100000:3.0:1787841848.465235:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695097344 00000100:00100000:3.0:1787841848.465255:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 180 00000100:00100000:3.0:1787841848.465261:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac1115e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fe7d2185-ae43-428e-8bfa-909f60138853+5:2355:x1874687695097728:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:1.0:1787841848.467966:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695097216 00000100:00100000:1.0:1787841848.467995:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695097216 00000100:00100000:1.0:1787841848.468078:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 310 00000100:00100000:1.0:1787841848.468090:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a1f1ce-26b5-4cc6-a1db-8e09063432da+13:2355:x1874687695097216:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:3.0:1787841848.468444:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac1115e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fe7d2185-ae43-428e-8bfa-909f60138853+5:2355:x1874687695097728:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 3179us (3794us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841848.468460:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 180 00000100:00100000:3.0:1787841848.468493:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 181 00000100:00100000:3.0:1787841848.468504:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6df4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+31:2355:x1874687695097344:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:1.0:1787841848.477855:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09a1f1ce-26b5-4cc6-a1db-8e09063432da+13:2355:x1874687695097216:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 9746us (13306us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841848.477891:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 310 00000100:00100000:3.0:1787841848.487372:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6df4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+31:2355:x1874687695097344:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 18855us (22680us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841848.487395:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 181 00000100:00080000:3.0:1787841848.487476:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787841848.487485:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787841848.487488:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1787841848.744313:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000001:00080000:2.0:1787841848.744336:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:2.0:1787841848.744343:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:3.0:1787841848.762816:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:3.0:1787841848.762856:0:5860:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff92cbd14e3f00 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1787841848.763308:0:5860:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff92cbe99d9800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff92cbd14e3840 00000020:00080000:3.0:1787841848.763313:0:5860:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff92cbe99d9f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff92cbff3c7800 00000020:00080000:3.0:1787841848.763357:0:5860:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:1.0:1787841848.763497:0:5871:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:1.0:1787841848.763787:0:5871:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:2.0:1787841848.897206:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841849.934364:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841850.948952:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787841851.653259:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787841851.653298:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac30e6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687715003264:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787841851.653400:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841851.653500:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715003264 00000100:00100000:1.0:1787841851.653527:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715003264 00000100:00100000:1.0:1787841851.653607:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787841851.653619:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac30e5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874687715003264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787841851.653669:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787841851.653743:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac30e5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874687715003264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 126us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841851.653752:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787841851.653816:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac30e6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687715003264:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1787841851.656629:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787841851.656844:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cc00cc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3300:1874687715003392:0@lo:400:kworker.0 00000100:00100000:0.0:1787841851.662318:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841851.662422:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cc00ddda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1874687715003904:0@lo:400:kworker.0 00000100:00100000:0.0:1787841851.662502:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841851.662541:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787841851.662549:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cc00cc4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874687715003520:0@lo:400:kworker.0 00000100:00100000:0.0:1787841851.662575:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841851.662628:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cc00cc4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1874687715003648:0@lo:400:kworker.0 00000100:00100000:0.0:1787841851.662656:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841851.662681:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787841851.662688:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbcd5ae1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687715003776:0@lo:400:kworker.0 00000100:00100000:0.0:1787841851.662734:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841851.662772:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715003392 00000100:00100000:0.0:1787841851.662783:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715003392 00000100:00100000:0.0:1787841851.662848:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1787841851.662859:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:3300:x1874687715003392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841851.662944:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:3300:x1874687715003392:12345-0@lo:400:kworker.0 Request processed in 87us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841851.664164:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715003904 00000100:00100000:2.0:1787841851.664175:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715003904 00000100:00100000:2.0:1787841851.664421:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715003520 00000100:00100000:2.0:1787841851.664425:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715003520 00000100:00100000:2.0:1787841851.664448:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715003648 00000100:00100000:2.0:1787841851.664451:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715003648 00000100:00100000:2.0:1787841851.664470:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1787841851.664480:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6dfcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874687715003904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841851.664584:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6dfcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874687715003904:12345-0@lo:400:kworker.0 Request processed in 106us (2081us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841851.664593:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1787841851.664626:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1787841851.664631:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6dfe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874687715003520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841851.664663:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6dfe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874687715003520:12345-0@lo:400:kworker.0 Request processed in 32us (2087us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841851.664670:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1787841851.664680:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1787841851.664686:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6dfe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1874687715003648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841851.664744:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6dfe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1874687715003648:12345-0@lo:400:kworker.0 Request processed in 58us (2087us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841851.664750:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00080000:2.0:1787841851.664880:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787841851.664935:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cc00cc4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1874687715003648:0@lo:400:kworker.0 00000100:00100000:0.0:1787841851.665788:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1787841851.665862:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715003776 00000100:00100000:0.0:1787841851.665869:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715003776 00000100:00100000:0.0:1787841851.666099:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787841851.666111:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6dfde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1874687715003776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841851.666201:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6dfde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1874687715003776:12345-0@lo:400:kworker.0 Request processed in 93us (3466us total) trans 0 rc 0/0 00000100:00080000:2.0:1787841851.666297:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787841851.666325:0:3298:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:2.0:1787841851.666334:0:3298:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff92cc00cc7c00, transno 4294967322 00000004:00080000:2.0:1787841851.666349:0:3298:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:2.0:1787841851.666378:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbcd5ae1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687715003776:0@lo:400:kworker.0 00000100:00100000:0.0:1787841851.671866:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787841851.672025:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cc00cc4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874687715003520:0@lo:400:kworker.0 00000100:00100000:0.0:1787841851.672045:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cc00cc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3300:1874687715003392:0@lo:400:kworker.0 00000100:00100000:0.0:1787841851.672060:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cc00ddda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1874687715003904:0@lo:400:kworker.0 00010000:00010000:2.0:1787841851.973586:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787841852.673193:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787841852.673290:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6ca4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874687715004032:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787841852.673492:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841852.674185:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715004032 00000100:00100000:1.0:1787841852.674199:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715004032 00000100:00100000:1.0:1787841852.674278:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787841852.674288:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd5ae1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874687715004032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787841852.675046:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787841852.675162:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd5ae1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874687715004032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 873us (1670us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841852.675171:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787841852.675673:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6ca4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874687715004032:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787841853.007532:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787841853.585115:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841853.585185:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841853.585222:0:12388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695098112 00000100:00100000:3.0:1787841853.585234:0:12388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695098112 00000100:00100000:3.0:1787841853.585311:0:12388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 85 00000100:00100000:3.0:1787841853.585323:0:12388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6df6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b2767a54-6703-4908-8414-eab6601e2ceb+7:2356:x1874687695098112:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:3.0:1787841853.585427:0:12388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6df6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b2767a54-6703-4908-8414-eab6601e2ceb+7:2356:x1874687695098112:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 105us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841853.585435:0:12388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 85 00000100:00080000:3.0:1787841853.585461:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787841853.586834:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695097856 00000100:00100000:0.0:1787841853.586849:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695097856 00000100:00100000:0.0:1787841853.586915:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 312 00000100:00100000:0.0:1787841853.587614:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a1f1ce-26b5-4cc6-a1db-8e09063432da+13:2356:x1874687695097856:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:0.0:1787841853.587752:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a1f1ce-26b5-4cc6-a1db-8e09063432da+13:2356:x1874687695097856:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 145us (2787us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841853.593666:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 312 00000100:00100000:3.0:1787841853.622361:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841853.622405:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841853.622430:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841853.622468:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695097984 00000100:00100000:3.0:1787841853.622480:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695097984 00000100:00100000:3.0:1787841853.622634:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695098368 00000100:00100000:3.0:1787841853.622638:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695098368 00000100:00100000:3.0:1787841853.622670:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 185 00000100:00100000:3.0:1787841853.622682:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6df70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+18:2356:x1874687695097984:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:3.0:1787841853.622809:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6df70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2767a54-6703-4908-8414-eab6601e2ceb+18:2356:x1874687695097984:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 129us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841853.622817:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 185 00000100:00100000:3.0:1787841853.622838:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 186 00000100:00100000:3.0:1787841853.622866:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6df52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fe7d2185-ae43-428e-8bfa-909f60138853+5:2357:x1874687695098368:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:3.0:1787841853.622896:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6df52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fe7d2185-ae43-428e-8bfa-909f60138853+5:2357:x1874687695098368:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 31us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841853.622902:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 186 00000100:00100000:3.0:1787841853.624082:0:9572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695098240 00000100:00100000:3.0:1787841853.624095:0:9572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695098240 00000100:00100000:3.0:1787841853.624183:0:9572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 86 00000100:00100000:3.0:1787841853.624194:0:9572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6df6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b2767a54-6703-4908-8414-eab6601e2ceb+5:2357:x1874687695098240:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:3.0:1787841853.624255:0:9572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6df6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b2767a54-6703-4908-8414-eab6601e2ceb+5:2357:x1874687695098240:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 64us (1849us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841853.624263:0:9572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 86 00000100:00080000:3.0:1787841853.624296:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787841853.624301:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00080000:2.0:1787841853.780810:0:5860:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:1.0:1787841853.780886:0:5871:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:1.0:1787841853.780964:0:5871:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:3.0:1787841853.955262:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841853.955624:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695098496 00000100:00100000:0.0:1787841853.955637:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695098496 00000100:00100000:0.0:1787841853.955721:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 238 00000100:00100000:0.0:1787841853.955732:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6df7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2767a54-6703-4908-8414-eab6601e2ceb+18:11302:x1874687695098496:12345-192.168.201.1@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1787841853.955854:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6df7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2767a54-6703-4908-8414-eab6601e2ceb+18:11302:x1874687695098496:12345-192.168.201.1@tcp:60:lhsmtool_posix.0 Request processed in 123us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841853.955861:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 238 00000100:00100000:3.0:1787841853.958649:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841853.958726:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695098752 00000100:00100000:0.0:1787841853.958737:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695098752 00000100:00100000:0.0:1787841853.958798:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 65 00000100:00100000:0.0:1787841853.958809:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6df7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b2767a54-6703-4908-8414-eab6601e2ceb+18:11302:x1874687695098752:12345-192.168.201.1@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787841853.959445:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6df7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b2767a54-6703-4908-8414-eab6601e2ceb+19:11302:x1874687695098752:12345-192.168.201.1@tcp:35:lhsmtool_posix.0 Request processed in 636us (804us total) trans 4294967520 rc 0/0 00000100:00100000:0.0:1787841853.959452:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 65 00010000:00010000:2.0:1787841854.021384:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787841854.154246:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841854.154340:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695098880 00000100:00100000:3.0:1787841854.154349:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695098880 00000100:00100000:3.0:1787841854.154412:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 239 00000100:00100000:3.0:1787841854.154421:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac30e6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fe7d2185-ae43-428e-8bfa-909f60138853+5:12101:x1874687695098880:12345-192.168.201.1@tcp:101:lsof.0 00010000:00010000:3.0:1787841854.154441:0:9449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841854.154462:0:9449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149de00/0xe3dac0c99afff282 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6b77 expref: -99 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841854.154525:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99afff289 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841854.154539:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99afff289 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841854.154564:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99afff289 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787841854.154770:0:9449:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787841854.154775:0:9449:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1787841854.154841:0:9449:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99afff289 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841854.155259:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149de00/0xe3dac0c99afff282 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b77 expref: 7 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841854.155280:0:9449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99afff289 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b77 expref: 6 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841854.155289:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92cbd1fc7e00) 00010000:00010000:3.0:1787841854.155292:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787841854.155296:0:9449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc149d600, rc 0) 00000100:00100000:3.0:1787841854.155408:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac30e6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fe7d2185-ae43-428e-8bfa-909f60138853+6:12101:x1874687695098880:12345-192.168.201.1@tcp:101:lsof.0 Request processed in 988us (1171us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841854.155417:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 239 00010000:00010000:2.0:1787841855.044482:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841856.065033:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787841856.769179:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac2dbc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687715004160:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787841856.769273:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841856.769458:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715004160 00000100:00100000:1.0:1787841856.769467:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715004160 00000100:00100000:1.0:1787841856.769541:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787841856.769552:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cc00ddda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874687715004160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787841856.769591:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787841856.769651:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cc00ddda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874687715004160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841856.769659:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787841856.769860:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cc00cc6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874687715004416:0@lo:400:kworker.0 00000100:00100000:1.0:1787841856.769881:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6ca4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3299:1874687715004288:0@lo:400:kworker.0 00000100:00100000:2.0:1787841856.769896:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841856.769955:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715004416 00000100:00100000:3.0:1787841856.769960:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715004416 00000100:00100000:3.0:1787841856.769995:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1787841856.770002:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cc00cc5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874687715004416:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787841856.770076:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787841856.770115:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cc00cc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687715004672:0@lo:400:kworker.0 00000100:00100000:2.0:1787841856.774298:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787841856.774320:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cc00cc7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1874687715004544:0@lo:400:kworker.0 00000100:00100000:2.0:1787841856.774397:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841856.774518:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715004544 00000100:00100000:2.0:1787841856.774527:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715004544 00000100:00100000:2.0:1787841856.774596:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1787841856.774607:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cc00cc4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874687715004544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841856.774659:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cc00cc4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874687715004544:12345-0@lo:400:kworker.0 Request processed in 54us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841856.774666:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1787841856.774732:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cc00cc7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1874687715004544:0@lo:400:kworker.0 00000100:00080000:2.0:1787841856.774784:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787841856.785402:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841856.785481:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cc00cc4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1874687715004800:0@lo:400:kworker.0 00000100:00100000:1.0:1787841856.785563:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841856.785620:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715004288 00000100:00100000:1.0:1787841856.785627:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715004288 00000100:00100000:2.0:1787841856.785888:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:2.0:1787841856.785899:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:3299:x1874687715004288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841856.785958:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:3299:x1874687715004288:12345-0@lo:400:kworker.0 Request processed in 62us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841856.785966:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:2.0:1787841856.786001:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715004800 00000100:00100000:2.0:1787841856.786005:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715004800 00000100:00100000:2.0:1787841856.786042:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1787841856.786049:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac2dbed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1874687715004800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841856.786092:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac2dbed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1874687715004800:12345-0@lo:400:kworker.0 Request processed in 44us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841856.786116:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00080000:2.0:1787841856.786135:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787841856.786173:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6ca4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3299:1874687715004288:0@lo:400:kworker.0 00000100:00100000:2.0:1787841856.786186:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cc00cc4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1874687715004800:0@lo:400:kworker.0 00000100:00100000:3.0:1787841856.786542:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cc00cc5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874687715004416:12345-0@lo:400:kworker.0 Request processed in 16539us (16644us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841856.786552:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1787841856.788763:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cc00cc6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874687715004416:0@lo:400:kworker.0 00000100:00100000:0.0:1787841856.791982:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841856.792099:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac2dbc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687715004160:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787841856.792272:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715004672 00000100:00100000:2.0:1787841856.792279:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715004672 00000100:00100000:2.0:1787841856.792357:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787841856.792366:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbc9544780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1874687715004672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841856.792424:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbc9544780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1874687715004672:12345-0@lo:400:kworker.0 Request processed in 59us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841856.792432:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:3.0:1787841856.792621:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787841856.792774:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cc00cc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687715004672:0@lo:400:kworker.0 00010000:00010000:2.0:1787841857.089009:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787841857.793270:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787841857.793296:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cc00cc6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874687715004928:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787841857.793369:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841857.794120:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715004928 00000100:00100000:1.0:1787841857.794130:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715004928 00000100:00100000:1.0:1787841857.794187:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787841857.794196:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6df5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874687715004928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787841857.794235:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787841857.794304:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6df5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874687715004928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (934us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841857.794311:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787841857.794420:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cc00cc6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874687715004928:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1787841857.857037:0:11682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787841857.857059:0:11682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787841857.857524:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:2.0:1787841857.857531:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787841858.112997:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787841858.713154:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841858.713211:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841858.713252:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841858.713283:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841858.713308:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841858.713346:0:9572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695099264 00000100:00100000:3.0:1787841858.713357:0:9572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695099264 00000100:00100000:3.0:1787841858.713412:0:9572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695099392 00000100:00100000:3.0:1787841858.713416:0:9572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695099392 00000100:00100000:3.0:1787841858.713438:0:9572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 88 00000100:00100000:3.0:1787841858.713450:0:9572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd7a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b2767a54-6703-4908-8414-eab6601e2ceb+7:2354:x1874687695099264:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:3.0:1787841858.713525:0:9572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd7a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b2767a54-6703-4908-8414-eab6601e2ceb+7:2354:x1874687695099264:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 78us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841858.713533:0:9572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 88 00000100:00100000:2.0:1787841858.714268:0:12018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695099520 00000100:00100000:2.0:1787841858.714276:0:12018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695099520 00000100:00100000:2.0:1787841858.714321:0:12018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695099136 00000100:00100000:2.0:1787841858.714324:0:12018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695099136 00000100:00100000:2.0:1787841858.714350:0:12018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 190 00000100:00100000:2.0:1787841858.714359:0:12018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff409680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fe7d2185-ae43-428e-8bfa-909f60138853+6:2354:x1874687695099520:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:2.0:1787841858.714402:0:12018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff409680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fe7d2185-ae43-428e-8bfa-909f60138853+6:2354:x1874687695099520:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 44us (1149us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841858.714427:0:12018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 190 00000100:00100000:2.0:1787841858.714447:0:12018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 191 00000100:00100000:2.0:1787841858.714454:0:12018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbc3dce940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b2767a54-6703-4908-8414-eab6601e2ceb+19:2354:x1874687695099136:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:2.0:1787841858.714484:0:12018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbc3dce940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b2767a54-6703-4908-8414-eab6601e2ceb+19:2354:x1874687695099136:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 30us (1201us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841858.714490:0:12018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 191 00000100:00100000:0.0:1787841858.716982:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695099008 00000100:00100000:0.0:1787841858.717000:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695099008 00000100:00100000:0.0:1787841858.717091:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 314 00000100:00100000:0.0:1787841858.717101:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a1f1ce-26b5-4cc6-a1db-8e09063432da+13:2354:x1874687695099008:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:0.0:1787841858.717177:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a1f1ce-26b5-4cc6-a1db-8e09063432da+13:2354:x1874687695099008:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 77us (4046us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841858.717185:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 314 00000100:00100000:2.0:1787841858.726303:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 89 00000100:00100000:2.0:1787841858.726333:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe99c7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b2767a54-6703-4908-8414-eab6601e2ceb+5:2354:x1874687695099392:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:2.0:1787841858.726415:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe99c7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b2767a54-6703-4908-8414-eab6601e2ceb+5:2354:x1874687695099392:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 99us (13106us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841858.726424:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 89 00000100:00080000:2.0:1787841858.729080:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787841858.729100:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787841858.729104:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1787841858.934778:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00010000:00010000:2.0:1787841859.137594:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787841859.866679:0:12726:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 10:44:18 (1787841858) 00010000:00010000:2.0:1787841860.160960:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841861.186880:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787841861.889361:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac2dbc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874687715005056:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787841861.889443:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841861.889885:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715005056 00000100:00100000:2.0:1787841861.889894:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715005056 00000100:00100000:2.0:1787841861.889957:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787841861.889967:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe99c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874687715005056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787841861.890020:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787841861.893386:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3298:1874687715005184:0@lo:400:kworker.0 00000100:00100000:1.0:1787841861.893467:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841861.893510:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf8e80b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1874687715005696:0@lo:400:kworker.0 00000100:00100000:1.0:1787841861.893538:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841861.893571:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787841861.893578:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e2e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874687715005312:0@lo:400:kworker.0 00000100:00100000:1.0:1787841861.893598:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841861.893645:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715005184 00000100:00100000:1.0:1787841861.893653:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715005184 00000100:00100000:1.0:1787841861.893714:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1787841861.893723:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:3298:x1874687715005184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841861.893940:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:3298:x1874687715005184:12345-0@lo:400:kworker.0 Request processed in 218us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841861.893949:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1787841861.893999:0:12018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715005696 00000100:00100000:1.0:1787841861.894003:0:12018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715005696 00000100:00100000:1.0:1787841861.894035:0:12018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715005312 00000100:00100000:1.0:1787841861.894038:0:12018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715005312 00000100:00100000:1.0:1787841861.894072:0:12018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1787841861.894080:0:12018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf8e81a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1874687715005696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841861.894112:0:12018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf8e81a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1874687715005696:12345-0@lo:400:kworker.0 Request processed in 34us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841861.894119:0:12018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1787841861.894132:0:12018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1787841861.894138:0:12018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf8e80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874687715005312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841861.894165:0:12018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf8e80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874687715005312:12345-0@lo:400:kworker.0 Request processed in 27us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841861.894172:0:12018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1787841861.894197:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff4d43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1874687715005440:0@lo:400:kworker.0 00000100:00100000:1.0:1787841861.894223:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841861.894244:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787841861.894250:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6c6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874687715005568:0@lo:400:kworker.0 00000100:00100000:1.0:1787841861.894276:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841861.894300:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715005440 00000100:00100000:1.0:1787841861.894304:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715005440 00000100:00100000:1.0:1787841861.894330:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1787841861.894337:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf8e80f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874687715005440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841861.894380:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf8e80f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874687715005440:12345-0@lo:400:kworker.0 Request processed in 44us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841861.894386:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1787841861.894406:0:12388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715005568 00000100:00100000:1.0:1787841861.894409:0:12388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715005568 00000100:00100000:1.0:1787841861.894438:0:12388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787841861.894445:0:12388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e65680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3300:x1874687715005568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841861.894476:0:12388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e65680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3300:x1874687715005568:12345-0@lo:400:kworker.0 Request processed in 33us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841861.894482:0:12388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787841861.894519:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6c6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874687715005568:0@lo:400:kworker.0 00000100:00100000:1.0:1787841861.894531:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff4d43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1874687715005440:0@lo:400:kworker.0 00000100:00100000:1.0:1787841861.894563:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e2e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874687715005312:0@lo:400:kworker.0 00000100:00100000:1.0:1787841861.894572:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3298:1874687715005184:0@lo:400:kworker.0 00000100:00100000:1.0:1787841861.894582:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf8e80b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1874687715005696:0@lo:400:kworker.0 00000100:00080000:0.0:1787841861.895821:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787841861.895833:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787841861.895836:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787841861.897152:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe99c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874687715005056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 7176us (7698us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841861.897166:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787841861.897282:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac2dbc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874687715005056:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787841862.208981:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787841862.914925:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787841862.914950:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cc00cc7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687715005824:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787841862.915028:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841862.915885:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715005824 00000100:00100000:2.0:1787841862.915900:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715005824 00000100:00100000:2.0:1787841862.915969:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787841862.915980:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e66580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874687715005824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787841862.916019:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787841862.916093:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e66580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874687715005824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (1065us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841862.916101:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787841862.916167:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cc00cc7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687715005824:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787841863.232946:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787841863.848740:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841863.848785:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841863.848841:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841863.848921:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841863.848999:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695099648 00000100:00100000:2.0:1787841863.849010:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695099648 00000100:00100000:2.0:1787841863.849072:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 316 00000100:00100000:2.0:1787841863.849081:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a1f1ce-26b5-4cc6-a1db-8e09063432da+13:2355:x1874687695099648:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:2.0:1787841863.849163:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a1f1ce-26b5-4cc6-a1db-8e09063432da+13:2355:x1874687695099648:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 83us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841863.849171:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 316 00000100:00100000:3.0:1787841863.849316:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695099776 00000100:00100000:3.0:1787841863.849321:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695099776 00000100:00100000:3.0:1787841863.849364:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695100160 00000100:00100000:3.0:1787841863.849367:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695100160 00000100:00100000:3.0:1787841863.849386:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 195 00000100:00100000:3.0:1787841863.849392:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac26dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+18:2355:x1874687695099776:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:3.0:1787841863.849426:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac26dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2767a54-6703-4908-8414-eab6601e2ceb+18:2355:x1874687695099776:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 35us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841863.849432:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 195 00000100:00100000:3.0:1787841863.849446:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 196 00000100:00100000:3.0:1787841863.849452:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac26df0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fe7d2185-ae43-428e-8bfa-909f60138853+6:2355:x1874687695100160:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:3.0:1787841863.849472:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac26df0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fe7d2185-ae43-428e-8bfa-909f60138853+6:2355:x1874687695100160:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 21us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841863.849477:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 196 00000100:00080000:2.0:1787841863.849656:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787841863.850416:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695099904 00000100:00100000:1.0:1787841863.850424:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695099904 00000100:00100000:1.0:1787841863.850485:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 91 00000100:00100000:1.0:1787841863.850494:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbc9546580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b2767a54-6703-4908-8414-eab6601e2ceb+7:2355:x1874687695099904:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:1.0:1787841863.850547:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbc9546580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b2767a54-6703-4908-8414-eab6601e2ceb+7:2355:x1874687695099904:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 55us (1761us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841863.850566:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 91 00000100:00080000:2.0:1787841863.851236:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787841863.853656:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841863.853926:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695100032 00000100:00100000:0.0:1787841863.853936:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695100032 00000100:00100000:0.0:1787841863.854016:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 73 00000100:00100000:0.0:1787841863.854028:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cc00cc4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b2767a54-6703-4908-8414-eab6601e2ceb+5:2353:x1874687695100032:12345-192.168.201.1@tcp:9:kworker.0 00000020:00000080:0.0:1787841863.854060:0:6688:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe3dac0c99affe5d9 00000100:00080000:0.0:1787841863.854070:0:6688:0:(import.c:65:import_set_state_nolock()) ffff92cbf6eb3800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787841863.854125:0:6688:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1787841863.854401:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cc00cc4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b2767a54-6703-4908-8414-eab6601e2ceb+2:2353:x1874687695100032:12345-192.168.201.1@tcp:9:kworker.0 Request processed in 375us (761us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841863.854409:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 73 00010000:00010000:3.0:1787841863.855030:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787841863.855157:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787841864.257378:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841865.281612:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787841865.669138:0:7643:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b2767a54-6703-4908-8414-eab6601e2ceb 00000020:00000080:2.0:1787841865.669149:0:7643:0:(genops.c:885:class_export_put()) final put ffff92cbf6eb7000/b2767a54-6703-4908-8414-eab6601e2ceb 00000020:00000080:1.0:1787841865.669299:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff92cbf6eb7000/b2767a54-6703-4908-8414-eab6601e2ceb for lustre-OST0001 00000020:00000080:1.0:1787841865.669355:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92cbf6eb3800 for lustre-OST0001 00000100:00100000:0.0:1787841865.797220:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841865.797330:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695100416 00000100:00100000:1.0:1787841865.797341:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695100416 00000100:00100000:1.0:1787841865.797412:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 66 00000100:00100000:1.0:1787841865.797423:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac26de940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b2767a54-6703-4908-8414-eab6601e2ceb+18:12323:x1874687695100416:12345-192.168.201.1@tcp:35:umount.0 00000100:00100000:1.0:1787841865.798026:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac26de940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b2767a54-6703-4908-8414-eab6601e2ceb+19:12323:x1874687695100416:12345-192.168.201.1@tcp:35:umount.0 Request processed in 603us (818us total) trans 4294967521 rc 0/0 00000100:00100000:1.0:1787841865.798035:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 66 00000100:00080000:2.0:1787841865.798363:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787841865.805917:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841865.811148:0:12373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695100672 00000100:00100000:3.0:1787841865.811164:0:12373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695100672 00000100:00100000:3.0:1787841865.811250:0:12373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 67 00000100:00100000:3.0:1787841865.811261:0:12373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac26dcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b2767a54-6703-4908-8414-eab6601e2ceb+19:12323:x1874687695100672:12345-192.168.201.1@tcp:35:umount.0 00000100:00100000:3.0:1787841865.811645:0:12373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac26dcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b2767a54-6703-4908-8414-eab6601e2ceb+20:12323:x1874687695100672:12345-192.168.201.1@tcp:35:umount.0 Request processed in 385us (5746us total) trans 4294967522 rc 0/0 00000100:00100000:3.0:1787841865.811654:0:12373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 67 00000100:00100000:3.0:1787841865.814218:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841865.814580:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695100928 00000100:00100000:0.0:1787841865.814589:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695100928 00000100:00100000:0.0:1787841865.814646:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 68 00000100:00100000:0.0:1787841865.814656:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbc73ec850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b2767a54-6703-4908-8414-eab6601e2ceb+20:12323:x1874687695100928:12345-192.168.201.1@tcp:35:umount.0 00000100:00100000:0.0:1787841865.815197:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbc73ec850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b2767a54-6703-4908-8414-eab6601e2ceb+21:12323:x1874687695100928:12345-192.168.201.1@tcp:35:umount.0 Request processed in 540us (986us total) trans 4294967523 rc 0/0 00000100:00100000:0.0:1787841865.815206:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 68 00000100:00100000:0.0:1787841865.823936:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841865.824051:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695101184 00000100:00100000:1.0:1787841865.824063:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695101184 00000100:00100000:1.0:1787841865.824123:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 69 00000100:00100000:1.0:1787841865.824134:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac26de940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b2767a54-6703-4908-8414-eab6601e2ceb+21:12323:x1874687695101184:12345-192.168.201.1@tcp:35:umount.0 00000100:00100000:1.0:1787841865.824503:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac26de940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b2767a54-6703-4908-8414-eab6601e2ceb+22:12323:x1874687695101184:12345-192.168.201.1@tcp:35:umount.0 Request processed in 369us (577us total) trans 4294967524 rc 0/0 00000100:00100000:1.0:1787841865.824511:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 69 00000100:00100000:2.0:1787841865.836009:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841865.836040:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841865.836063:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841865.836196:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695101312 00000100:00100000:3.0:1787841865.836220:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695101312 00000100:00100000:3.0:1787841865.836281:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695101568 00000100:00100000:3.0:1787841865.836284:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695101568 00000100:00100000:3.0:1787841865.836301:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695101440 00000100:00100000:3.0:1787841865.836304:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695101440 00000100:00100000:3.0:1787841865.836321:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 18 00000100:00100000:3.0:1787841865.836332:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cc00cc7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09a1f1ce-26b5-4cc6-a1db-8e09063432da+15:2355:x1874687695101312:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787841865.836351:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787841865.836372:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92cbc6599600/0xe3dac0c99affe29f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6702 expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841865.836390:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787841865.836459:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cc00cc7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09a1f1ce-26b5-4cc6-a1db-8e09063432da+14:2355:x1874687695101312:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 128us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841865.836466:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 18 00000100:00100000:3.0:1787841865.836484:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 19 00000100:00100000:3.0:1787841865.836491:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cc00cc6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09a1f1ce-26b5-4cc6-a1db-8e09063432da+13:2355:x1874687695101568:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787841865.836498:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787841865.836508:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92cbc6599c00/0xe3dac0c99affe515 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d67cd expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841865.836516:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787841865.836531:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cc00cc6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09a1f1ce-26b5-4cc6-a1db-8e09063432da+12:2355:x1874687695101568:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 42us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841865.836536:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 19 00000100:00100000:3.0:1787841865.836548:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 20 00000100:00100000:3.0:1787841865.836555:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cc00cc7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09a1f1ce-26b5-4cc6-a1db-8e09063432da+11:2355:x1874687695101440:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787841865.836570:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787841865.836579:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92cbc6725600/0xe3dac0c99affe267 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d66ca expref: 11 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841865.836588:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787841865.836604:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cc00cc7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09a1f1ce-26b5-4cc6-a1db-8e09063432da+10:2355:x1874687695101440:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 50us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841865.836609:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 20 00000100:00100000:3.0:1787841865.836734:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841865.837964:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695101952 00000100:00100000:1.0:1787841865.837973:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695101952 00000100:00100000:1.0:1787841865.838052:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 74 00000100:00100000:1.0:1787841865.838062:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe99c7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b2767a54-6703-4908-8414-eab6601e2ceb+7:2353:x1874687695101952:12345-192.168.201.1@tcp:9:umount.0 00000020:00000080:1.0:1787841865.838092:0:6687:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe3dac0c99affe83a 00000020:00010000:1.0:1787841865.838099:0:6687:0:(genops.c:1921:obd_stale_export_put()) Put export ffff92cc00d87800: total 0 00000100:00080000:1.0:1787841865.838103:0:6687:0:(import.c:65:import_set_state_nolock()) ffff92cc00d82000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787841865.838142:0:6687:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:1.0:1787841865.838406:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe99c7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b2767a54-6703-4908-8414-eab6601e2ceb+5:2353:x1874687695101952:12345-192.168.201.1@tcp:9:umount.0 Request processed in 346us (1671us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841865.838414:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 74 00000020:00010000:1.0:1787841865.838436:0:5827:0:(genops.c:1907:obd_stale_export_get()) Get export ffff92cc00d87800: total 0 00010000:00010000:1.0:1787841865.838457:0:5827:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff92cc00d87800, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1787841865.838514:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ef39c8ac/0xe3dac0c99afff27b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b70 expref: 4 pid: 9572 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841865.838551:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7800b92/0xe3dac0c99affebdd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d69a2 expref: 3 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841865.838567:0:5827:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff92cc00d87800, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1787841865.838579:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841865.838581:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841865.838583:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787841865.838650:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787841865.849282:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841865.849393:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695102976 00000100:00100000:0.0:1787841865.849405:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695102976 00000100:00100000:0.0:1787841865.849468:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 240 00000100:00100000:0.0:1787841865.849480:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe99c5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+22:2353:x1874687695102976:12345-192.168.201.1@tcp:39:umount.0 00000020:00000080:0.0:1787841865.849532:0:5837:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe3dac0c99affe275 00000020:00010000:0.0:1787841865.849555:0:5837:0:(genops.c:1921:obd_stale_export_put()) Put export ffff92cbf71a9800: total 0 00000100:00080000:0.0:1787841865.849562:0:5837:0:(import.c:65:import_set_state_nolock()) ffff92cbf71af000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787841865.849601:0:5837:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:0.0:1787841865.850075:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe99c5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2767a54-6703-4908-8414-eab6601e2ceb+21:2353:x1874687695102976:12345-192.168.201.1@tcp:39:umount.0 Request processed in 596us (805us total) trans 4294967525 rc 0/0 00000100:00100000:0.0:1787841865.850085:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 240 00000020:00010000:2.0:1787841865.851387:0:5826:0:(genops.c:1907:obd_stale_export_get()) Get export ffff92cbf71a9800: total 0 00010000:00010000:2.0:1787841865.851408:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841865.851466:0:5826:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff92cbf71a9800, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1787841865.851504:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92cbc3b04b00) 00010000:00010000:2.0:1787841865.851508:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787841865.851531:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149cc00/0xe3dac0c99affebc8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d699b expref: 20 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841865.851554:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92cbc89cd700) 00010000:00010000:2.0:1787841865.851557:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787841865.851561:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105a00/0xe3dac0c99afff23c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b5b expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841865.851575:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92cbc89cd700) 00010000:00010000:2.0:1787841865.851577:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787841865.851581:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3be00/0xe3dac0c99afff266 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b69 expref: 18 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841865.851592:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92cbc3b04b00) 00010000:00010000:2.0:1787841865.851595:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787841865.851598:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105600/0xe3dac0c99affeb9e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d698d expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841865.851611:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92cbd1fc7300) 00010000:00010000:2.0:1787841865.851614:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787841865.851618:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c200/0xe3dac0c99affe89c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d68c9 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841865.851630:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff92cbc57e3500) 00010000:00010000:2.0:1787841865.851632:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787841865.851643:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725a00/0xe3dac0c99affe53f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d67db expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841865.851664:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92cbc57e3e00) 00010000:00010000:2.0:1787841865.851666:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787841865.851670:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c600/0xe3dac0c99affef3a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6a97 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841865.851693:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92cbc57e3e00) 00010000:00010000:2.0:1787841865.851732:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787841865.851738:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3ba00/0xe3dac0c99affec5b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d69c5 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841865.851754:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92cbc3b04b00) 00010000:00010000:2.0:1787841865.851757:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787841865.851760:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3b800/0xe3dac0c99affeabe lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6955 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841865.851775:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92cbd1fc7300) 00010000:00010000:2.0:1787841865.851778:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787841865.851781:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9c000/0xe3dac0c99affe5af lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d67f7 expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841865.851794:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92cbc89cd700) 00010000:00010000:2.0:1787841865.851797:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787841865.851800:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3aa00/0xe3dac0c99afff15c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b23 expref: 10 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841865.851815:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92cbd1fc7e00) 00010000:00010000:2.0:1787841865.851823:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787841865.851828:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d200/0xe3dac0c99affec3f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d69be expref: 9 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841865.851843:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff92cbc57e3b00) 00010000:00010000:2.0:1787841865.851845:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787841865.851848:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbffa3ac00/0xe3dac0c99affe55b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d67e2 expref: 8 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841865.851861:0:5826:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff92cbf71a9800, canceled 13 locks, left on hash table 0. 00010000:00010000:2.0:1787841865.851874:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841865.851876:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841865.851878:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841866.305873:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787841866.897372:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841866.897432:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841866.897533:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695103104 00000100:00100000:1.0:1787841866.897553:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695103104 00000100:00100000:1.0:1787841866.897615:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 317 00000100:00100000:1.0:1787841866.897625:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a1f1ce-26b5-4cc6-a1db-8e09063432da+10:2354:x1874687695103104:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:1.0:1787841866.897770:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09a1f1ce-26b5-4cc6-a1db-8e09063432da+10:2354:x1874687695103104:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 146us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841866.897779:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 317 00000100:00100000:0.0:1787841866.899237:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695103232 00000100:00100000:0.0:1787841866.899252:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695103232 00000100:00100000:0.0:1787841866.899348:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 197 00000100:00100000:0.0:1787841866.899357:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6ca4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fe7d2185-ae43-428e-8bfa-909f60138853+6:2354:x1874687695103232:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:0.0:1787841866.899456:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6ca4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fe7d2185-ae43-428e-8bfa-909f60138853+6:2354:x1874687695103232:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 99us (2022us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841866.899464:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 197 00000100:00080000:2.0:1787841866.899532:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787841867.009567:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787841867.009602:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf8e80b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874687715005952:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787841867.009674:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841867.010011:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac26de580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874687715006208:0@lo:400:kworker.0 00000100:00100000:0.0:1787841867.010044:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841867.010063:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787841867.010068:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac26dc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1874687715006336:0@lo:400:kworker.0 00000100:00100000:0.0:1787841867.010087:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841867.010118:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715006208 00000100:00100000:0.0:1787841867.010125:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715006208 00000100:00100000:0.0:1787841867.010167:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715006336 00000100:00100000:0.0:1787841867.010169:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715006336 00000100:00100000:0.0:1787841867.010207:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1787841867.010214:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac26dfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874687715006208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841867.010265:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac26dfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874687715006208:12345-0@lo:400:kworker.0 Request processed in 50us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841867.010271:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1787841867.010288:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1787841867.010293:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac26dc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1874687715006336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841867.010320:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac26dc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1874687715006336:12345-0@lo:400:kworker.0 Request processed in 27us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841867.010326:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00080000:0.0:1787841867.010343:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787841867.010372:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac26dc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1874687715006336:0@lo:400:kworker.0 00000100:00100000:0.0:1787841867.010382:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac26de580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874687715006208:0@lo:400:kworker.0 00000100:00100000:2.0:1787841867.010470:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac26ded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874687715006464:0@lo:400:kworker.0 00000100:00100000:2.0:1787841867.010513:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841867.010556:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787841867.010562:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac26dcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3300:1874687715006080:0@lo:400:kworker.0 00000100:00100000:2.0:1787841867.010599:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841867.010622:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac26dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1874687715006592:0@lo:400:kworker.0 00000100:00100000:2.0:1787841867.010645:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841867.010927:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715005952 00000100:00100000:1.0:1787841867.010934:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715005952 00000100:00100000:1.0:1787841867.010985:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787841867.010993:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac2dbc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874687715005952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787841867.011032:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787841867.011072:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac2dbc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874687715005952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (1397us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841867.011079:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787841867.011104:0:12018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715006592 00000100:00100000:1.0:1787841867.011108:0:12018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715006592 00000100:00100000:1.0:1787841867.011131:0:12018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1787841867.011136:0:12018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff3d0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874687715006592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841867.011169:0:12018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff3d0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874687715006592:12345-0@lo:400:kworker.0 Request processed in 33us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841867.011174:0:12018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1787841867.011207:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac26dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1874687715006592:0@lo:400:kworker.0 00000100:00100000:3.0:1787841867.011313:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf8e80b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874687715005952:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787841867.012815:0:9572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715006464 00000100:00100000:0.0:1787841867.012825:0:9572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715006464 00000100:00100000:0.0:1787841867.012896:0:9572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787841867.012906:0:9572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff3d3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1874687715006464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841867.012984:0:9572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff3d3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1874687715006464:12345-0@lo:400:kworker.0 Request processed in 80us (2469us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841867.012990:0:9572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787841867.013012:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715006080 00000100:00100000:0.0:1787841867.013015:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715006080 00000100:00100000:0.0:1787841867.013036:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1787841867.013042:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:3300:x1874687715006080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841867.013067:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:3300:x1874687715006080:12345-0@lo:400:kworker.0 Request processed in 26us (2479us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841867.013082:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1787841867.013220:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac26dcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3300:1874687715006080:0@lo:400:kworker.0 00000100:00100000:3.0:1787841867.013233:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac26ded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874687715006464:0@lo:400:kworker.0 00000100:00080000:2.0:1787841867.013324:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787841867.013329:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787841867.013331:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:3.0:1787841867.073225:0:11682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787841867.073235:0:11682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787841867.074179:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1787841867.074195:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787841867.332093:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787841868.033256:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff3d1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687715006720:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787841868.033335:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841868.034091:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715006720 00000100:00100000:1.0:1787841868.034100:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715006720 00000100:00100000:1.0:1787841868.034166:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787841868.034187:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac26de580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874687715006720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787841868.034229:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787841868.034300:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac26de580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874687715006720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (964us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841868.034308:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787841868.034452:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff3d1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687715006720:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787841868.167119:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841868.167171:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841868.167238:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841868.167404:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695103360 00000100:00100000:0.0:1787841868.167417:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695103360 00000100:00100000:0.0:1787841868.167492:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695103616 00000100:00100000:0.0:1787841868.167496:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695103616 00000100:00100000:0.0:1787841868.167544:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695103488 00000100:00100000:0.0:1787841868.167547:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695103488 00000100:00100000:0.0:1787841868.167567:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 21 00000100:00100000:0.0:1787841868.167577:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff3d1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09a1f1ce-26b5-4cc6-a1db-8e09063432da+12:2354:x1874687695103360:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787841868.167594:0:7632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787841868.167620:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92cbc6598800/0xe3dac0c99affe347 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6717 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841868.167643:0:7632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787841868.167773:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff3d1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09a1f1ce-26b5-4cc6-a1db-8e09063432da+11:2354:x1874687695103360:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 197us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841868.167781:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 21 00000100:00100000:0.0:1787841868.167799:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 22 00000100:00100000:0.0:1787841868.167806:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff3d21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09a1f1ce-26b5-4cc6-a1db-8e09063432da+10:2354:x1874687695103616:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787841868.167814:0:7632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787841868.167823:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92cbc6725200/0xe3dac0c99affe50e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d67c6 expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841868.167844:0:7632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787841868.167863:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff3d21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09a1f1ce-26b5-4cc6-a1db-8e09063432da+9:2354:x1874687695103616:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 57us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841868.167882:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 22 00000100:00100000:0.0:1787841868.167895:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 23 00000100:00100000:0.0:1787841868.167902:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff3d0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09a1f1ce-26b5-4cc6-a1db-8e09063432da+8:2354:x1874687695103488:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787841868.167910:0:7632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787841868.167918:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92cbc6598000/0xe3dac0c99affe34e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6741 expref: 8 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841868.167927:0:7632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787841868.167942:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff3d0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09a1f1ce-26b5-4cc6-a1db-8e09063432da+7:2354:x1874687695103488:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 41us (704us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841868.167947:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 23 00000100:00100000:3.0:1787841868.175263:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841868.175351:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695103872 00000100:00100000:0.0:1787841868.175367:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695103872 00000100:00100000:0.0:1787841868.175467:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 241 00000100:00100000:0.0:1787841868.175479:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac3093c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fe7d2185-ae43-428e-8bfa-909f60138853+6:2353:x1874687695103872:12345-192.168.201.1@tcp:39:umount.0 00000020:00000080:0.0:1787841868.175549:0:9449:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe3dac0c99affe35c 00000020:00010000:0.0:1787841868.175557:0:9449:0:(genops.c:1921:obd_stale_export_put()) Put export ffff92cbf71c0000: total 0 00000100:00080000:0.0:1787841868.175562:0:9449:0:(import.c:65:import_set_state_nolock()) ffff92cbf71c3800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787841868.175596:0:9449:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000020:00010000:3.0:1787841868.175637:0:5827:0:(genops.c:1907:obd_stale_export_get()) Get export ffff92cbf71c0000: total 0 00010000:00010000:3.0:1787841868.175835:0:5827:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff92cbf71c0000, canceled 0 locks, left on hash table 1. 00000100:00100000:0.0:1787841868.175959:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac3093c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fe7d2185-ae43-428e-8bfa-909f60138853+5:2353:x1874687695103872:12345-192.168.201.1@tcp:39:umount.0 Request processed in 481us (712us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1787841868.175968:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 241 00010000:00010000:3.0:1787841868.176068:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92cbd1fc7e00) 00010000:00010000:3.0:1787841868.176075:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787841868.176089:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99afff289 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b77 expref: 4 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841868.176144:0:5827:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff92cbf71c0000, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1787841868.176171:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841868.176174:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841868.176176:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787841868.176419:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787841868.201761:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841868.202023:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695104128 00000100:00100000:2.0:1787841868.202034:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695104128 00000100:00100000:2.0:1787841868.202093:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 319 00000100:00100000:2.0:1787841868.202104:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcd6b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a1f1ce-26b5-4cc6-a1db-8e09063432da+7:2353:x1874687695104128:12345-192.168.201.1@tcp:251:umount.0 00000020:00000080:2.0:1787841868.202150:0:5831:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe3dac0c99affe252 00000020:00010000:2.0:1787841868.202158:0:5831:0:(genops.c:1921:obd_stale_export_put()) Put export ffff92cac12d5800: total 0 00000100:00080000:2.0:1787841868.202163:0:5831:0:(import.c:65:import_set_state_nolock()) ffff92cac12d1000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1787841868.202248:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcd6b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09a1f1ce-26b5-4cc6-a1db-8e09063432da+3:2353:x1874687695104128:12345-192.168.201.1@tcp:251:umount.0 Request processed in 146us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841868.202255:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 319 00000020:00010000:3.0:1787841868.203230:0:5826:0:(genops.c:1907:obd_stale_export_get()) Get export ffff92cac12d5800: total 0 00010000:00010000:3.0:1787841868.203236:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841868.203278:0:5826:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff92cac12d5800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1787841868.203310:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92cbc6598600/0xe3dac0c99affe2a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6709 expref: 2 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841868.203328:0:5826:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff92cac12d5800, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1787841868.203337:0:5826:0:(genops.c:885:class_export_put()) final put ffff92cac12d5800/09a1f1ce-26b5-4cc6-a1db-8e09063432da 00010000:00010000:3.0:1787841868.203355:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841868.203357:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841868.203359:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787841868.203401:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff92cac12d5800/09a1f1ce-26b5-4cc6-a1db-8e09063432da for MGS 00000020:00000080:0.0:1787841868.203439:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92cac12d1000 for MGS 00010000:00010000:3.0:1787841868.352951:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787841869.143138:0:6717:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b2767a54-6703-4908-8414-eab6601e2ceb 00000020:00000080:2.0:1787841869.143153:0:6717:0:(genops.c:885:class_export_put()) final put ffff92cc00d87800/b2767a54-6703-4908-8414-eab6601e2ceb 00000020:00000080:2.0:1787841869.143202:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff92cc00d87800/b2767a54-6703-4908-8414-eab6601e2ceb for lustre-OST0000 00000020:00000080:2.0:1787841869.143290:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92cc00d82000 for lustre-OST0000 00000001:00100000:1.0:1787841869.173648:0:5860:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of fe7d2185-ae43-428e-8bfa-909f60138853 00000001:00080000:1.0:1787841869.173677:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:1.0:1787841869.173685:0:5860:0:(genops.c:885:class_export_put()) final put ffff92cbf71c0000/fe7d2185-ae43-428e-8bfa-909f60138853 00000001:00100000:1.0:1787841869.173735:0:5860:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of b2767a54-6703-4908-8414-eab6601e2ceb 00000001:00080000:1.0:1787841869.173741:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:1.0:1787841869.173763:0:5860:0:(genops.c:885:class_export_put()) final put ffff92cbf71a9800/b2767a54-6703-4908-8414-eab6601e2ceb 00000020:00000080:3.0:1787841869.174040:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff92cbf71c0000/fe7d2185-ae43-428e-8bfa-909f60138853 for lustre-MDT0000 00000020:00000080:3.0:1787841869.174172:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff92cbf71a9800/b2767a54-6703-4908-8414-eab6601e2ceb for lustre-MDT0000 00000020:00000080:3.0:1787841869.174227:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92cbf71c3800 for lustre-MDT0000 00000020:00000080:3.0:1787841869.174233:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92cbf71af000 for lustre-MDT0000 00010000:00010000:3.0:1787841869.377890:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787841870.401070:0:12925:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00010000:00010000:2.0:1787841870.424073:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787841870.425871:0:12925:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1787841870.425931:0:12925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc6599e00/0xe3dac0c99affe2e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe2ec expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841870.425948:0:12925:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc6599e00/0xe3dac0c99affe2e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xe3dac0c99affe2ec expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841870.425956:0:12925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc6599e00/0xe3dac0c99affe2e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xe3dac0c99affe2ec expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841870.425963:0:12925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.101@tcp lock: ffff92cbc6599e00/0xe3dac0c99affe2e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xe3dac0c99affe2ec expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841870.425991:0:12925:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787841870.425998:0:12925:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1787841870.426023:0:12925:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787841870.426028:0:12925:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787841870.426035:0:12925:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787841870.426063:0:12925:0:(import.c:65:import_set_state_nolock()) ffff92cbcd850800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1787841870.426122:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787841870.426131:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.101@tcp lock: ffff92cbc6599e00/0xe3dac0c99affe2e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xe3dac0c99affe2ec expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841870.426139:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6599e00 already unused, calling callback (ffffffffc1d9fc20) 10000000:00010000:3.0:1787841870.426143:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.101@tcp lock: ffff92cbc6599e00/0xe3dac0c99affe2e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xe3dac0c99affe2ec expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841870.426296:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.101@tcp lock: ffff92cbc6599e00/0xe3dac0c99affe2e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xe3dac0c99affe2ec expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787841870.426305:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.101@tcp lock: ffff92cbc6599e00/0xe3dac0c99affe2e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xe3dac0c99affe2ec expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787841870.426312:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787841870.426315:0:5826:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1787841870.426318:0:5826:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1787841870.426353:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.101@tcp lock: ffff92cbc6599e00/0xe3dac0c99affe2e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xe3dac0c99affe2ec expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841870.426360:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787841870.426388:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.101@tcp lock: ffff92cbc6599e00/0xe3dac0c99affe2e5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xe3dac0c99affe2ec expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841870.426396:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.101@tcp lock: ffff92cbc6599e00/0xe3dac0c99affe2e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xe3dac0c99affe2ec expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841870.426411:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841870.426413:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841870.426415:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787841870.426470:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac30921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3299:1874687715006976:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787841870.426565:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841870.426780:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac26dc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3297:1874687715006848:0@lo:39:umount.0 00000100:00100000:1.0:1787841870.426822:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841870.426934:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715006976 00000100:00100000:3.0:1787841870.426941:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715006976 00000100:00100000:3.0:1787841870.426998:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787841870.427008:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbcdb79c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:3299:x1874687715006976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787841870.427022:0:7632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787841870.427037:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92cbc169b400/0xe3dac0c99affe2ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe3dac0c99affe2e5 expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841870.427066:0:7632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787841870.427108:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbcdb79c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f6e7591a-84a0-4774-9d28-b3ed28591dc5+18:3299:x1874687715006976:12345-0@lo:103:ldlm_bl.0 Request processed in 102us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841870.427116:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787841870.427453:0:12018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715006848 00000100:00100000:0.0:1787841870.427458:0:12018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715006848 00000100:00100000:0.0:1787841870.427505:0:12018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1787841870.427513:0:12018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf8e80b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1874687715006848:12345-0@lo:39:umount.0 00000020:00000080:0.0:1787841870.427550:0:12018:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe3dac0c99affe061 00000100:00080000:0.0:1787841870.427560:0:12018:0:(import.c:65:import_set_state_nolock()) ffff92cbcd857000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1787841870.427626:0:12018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf8e80b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+1:3297:x1874687715006848:12345-0@lo:39:umount.0 Request processed in 114us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841870.427632:0:12018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:0.0:1787841870.427640:0:12018:0:(genops.c:885:class_export_put()) final put ffff92cbcd856800/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:1.0:1787841870.427752:0:3297:0:(import.c:65:import_set_state_nolock()) ffff92cbcd850800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1787841870.427768:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac26dc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3297:1874687715006848:0@lo:39:umount.0 00010000:00010000:2.0:1787841870.427881:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787841870.427938:0:12925:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787841870.427942:0:12925:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787841870.427947:0:12925:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787841870.428933:0:12925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc6599400/0xe3dac0c99affe2f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe2fa expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841870.428950:0:12925:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc6599400/0xe3dac0c99affe2f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xe3dac0c99affe2fa expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841870.428957:0:12925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc6599400/0xe3dac0c99affe2f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xe3dac0c99affe2fa expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841870.428964:0:12925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.101@tcp lock: ffff92cbc6599400/0xe3dac0c99affe2f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xe3dac0c99affe2fa expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841870.428984:0:12925:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787841870.428990:0:12925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc169b000/0xe3dac0c99affe20c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe213 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841870.428996:0:12925:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc169b000/0xe3dac0c99affe20c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe3dac0c99affe213 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841870.429002:0:12925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc169b000/0xe3dac0c99affe20c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xe3dac0c99affe213 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841870.429018:0:12925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.101@tcp lock: ffff92cbc169b000/0xe3dac0c99affe20c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xe3dac0c99affe213 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841870.429029:0:12925:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787841870.429034:0:12925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc169a800/0xe3dac0c99affe500 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe507 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841870.429041:0:12925:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc169a800/0xe3dac0c99affe500 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe3dac0c99affe507 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841870.429048:0:12925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc169a800/0xe3dac0c99affe500 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xe3dac0c99affe507 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841870.429054:0:12925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.101@tcp lock: ffff92cbc169a800/0xe3dac0c99affe500 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xe3dac0c99affe507 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841870.429061:0:12925:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1787841870.429066:0:12925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc149ce00/0xe3dac0c99affdfc0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affdfc7 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841870.429072:0:12925:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc149ce00/0xe3dac0c99affdfc0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe3dac0c99affdfc7 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841870.429078:0:12925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc149ce00/0xe3dac0c99affdfc0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xe3dac0c99affdfc7 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841870.429085:0:12925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.101@tcp lock: ffff92cbc149ce00/0xe3dac0c99affdfc0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xe3dac0c99affdfc7 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841870.429100:0:12925:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:0.0:1787841870.429103:0:12925:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1787841870.429126:0:12925:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1787841870.429130:0:12925:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1787841870.429134:0:12925:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787841870.429140:0:12925:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00000020:00080000:0.0:1787841870.429147:0:12925:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff92cbf71ac000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787841870.429153:0:12925:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff92cbc8b75000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787841870.429159:0:12925:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff92cbf7360000) has exports, disconnecting them 00000020:00080000:0.0:1787841870.429163:0:12925:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff92cbf71ac000), last request at 1787841867 00000020:00000080:0.0:1787841870.429169:0:12925:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe3dac0c99affe1d4 00000100:00080000:0.0:1787841870.429186:0:12925:0:(import.c:65:import_set_state_nolock()) ffff92cbf71ae000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787841870.429234:0:12925:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff92cbf71ac000): rc 0 00000020:00000080:0.0:1787841870.429237:0:12925:0:(genops.c:885:class_export_put()) final put ffff92cbf71ac000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1787841870.429243:0:12925:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff92cbc8b75000), last request at 1787841867 00000020:00000080:0.0:1787841870.429246:0:12925:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe3dac0c99affe0fb 00000100:00080000:0.0:1787841870.429250:0:12925:0:(import.c:65:import_set_state_nolock()) ffff92cbffa02000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787841870.429255:0:12925:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff92cbc8b75000): rc 0 00000020:00000080:0.0:1787841870.429257:0:12925:0:(genops.c:885:class_export_put()) final put ffff92cbc8b75000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:0.0:1787841870.429264:0:12925:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa5d883ba3ae0 00000100:00080000:0.0:1787841870.429283:0:12925:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787841870.429286:0:12925:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:0.0:1787841870.429296:0:12925:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1787841870.429356:0:12925:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1787841870.429378:0:12925:0:(import.c:65:import_set_state_nolock()) ffff92cbff5b2800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1787841870.429392:0:12925:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787841870.429394:0:12925:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:0.0:1787841870.429408:0:12925:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1787841870.429486:0:12925:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1787841870.429494:0:12925:0:(import.c:65:import_set_state_nolock()) ffff92cbffa70000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1787841870.429524:0:12925:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff92cbf7360000) has no exports 00010000:00010000:2.0:1787841870.434285:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1787841870.434303:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.101@tcp lock: ffff92cbc6599400/0xe3dac0c99affe2f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xe3dac0c99affe2fa expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841870.434317:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6599400 already unused, calling callback (ffffffffc1d9fc20) 10000000:00010000:2.0:1787841870.434322:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.101@tcp lock: ffff92cbc6599400/0xe3dac0c99affe2f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xe3dac0c99affe2fa expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841870.434334:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.101@tcp lock: ffff92cbc6599400/0xe3dac0c99affe2f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xe3dac0c99affe2fa expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787841870.434364:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.101@tcp lock: ffff92cbc6599400/0xe3dac0c99affe2f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xe3dac0c99affe2fa expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787841870.434370:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787841870.434373:0:5827:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:2.0:1787841870.434375:0:5827:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:2.0:1787841870.434427:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.101@tcp lock: ffff92cbc6599400/0xe3dac0c99affe2f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xe3dac0c99affe2fa expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841870.434434:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787841870.434484:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.101@tcp lock: ffff92cbc6599400/0xe3dac0c99affe2f3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xe3dac0c99affe2fa expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841870.434492:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.101@tcp lock: ffff92cbc6599400/0xe3dac0c99affe2f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xe3dac0c99affe2fa expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841870.434516:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787841870.434519:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.101@tcp lock: ffff92cbc169b000/0xe3dac0c99affe20c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xe3dac0c99affe213 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841870.434525:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc169b000 already unused, calling callback (ffffffffc1d9fc20) 10000000:00010000:2.0:1787841870.434528:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.101@tcp lock: ffff92cbc169b000/0xe3dac0c99affe20c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xe3dac0c99affe213 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841870.434535:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.101@tcp lock: ffff92cbc169b000/0xe3dac0c99affe20c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xe3dac0c99affe213 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787841870.434541:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.101@tcp lock: ffff92cbc169b000/0xe3dac0c99affe20c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xe3dac0c99affe213 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787841870.434556:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1787841870.434558:0:5827:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1787841870.434560:0:5827:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1787841870.434576:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.101@tcp lock: ffff92cbc169b000/0xe3dac0c99affe20c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xe3dac0c99affe213 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841870.434581:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787841870.434587:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.101@tcp lock: ffff92cbc169b000/0xe3dac0c99affe20c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xe3dac0c99affe213 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841870.434593:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.101@tcp lock: ffff92cbc169b000/0xe3dac0c99affe20c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xe3dac0c99affe213 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841870.434607:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787841870.434611:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.101@tcp lock: ffff92cbc169a800/0xe3dac0c99affe500 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xe3dac0c99affe507 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841870.434618:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc169a800 already unused, calling callback (ffffffffc1d9fc20) 10000000:00010000:2.0:1787841870.434620:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.101@tcp lock: ffff92cbc169a800/0xe3dac0c99affe500 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xe3dac0c99affe507 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841870.434628:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.101@tcp lock: ffff92cbc169a800/0xe3dac0c99affe500 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xe3dac0c99affe507 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787841870.434634:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.101@tcp lock: ffff92cbc169a800/0xe3dac0c99affe500 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xe3dac0c99affe507 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787841870.434639:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1787841870.434641:0:5827:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1787841870.434643:0:5827:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1787841870.434664:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.101@tcp lock: ffff92cbc169a800/0xe3dac0c99affe500 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xe3dac0c99affe507 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841870.434670:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787841870.434682:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.101@tcp lock: ffff92cbc169a800/0xe3dac0c99affe500 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xe3dac0c99affe507 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841870.434689:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.101@tcp lock: ffff92cbc169a800/0xe3dac0c99affe500 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xe3dac0c99affe507 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841870.434718:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787841870.434722:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.101@tcp lock: ffff92cbc149ce00/0xe3dac0c99affdfc0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xe3dac0c99affdfc7 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841870.434729:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc149ce00 already unused, calling callback (ffffffffc1d9fc20) 10000000:00010000:2.0:1787841870.434731:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.101@tcp lock: ffff92cbc149ce00/0xe3dac0c99affdfc0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xe3dac0c99affdfc7 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841870.434738:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.101@tcp lock: ffff92cbc149ce00/0xe3dac0c99affdfc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xe3dac0c99affdfc7 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787841870.434744:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.101@tcp lock: ffff92cbc149ce00/0xe3dac0c99affdfc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xe3dac0c99affdfc7 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787841870.434749:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1787841870.434751:0:5827:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1787841870.434753:0:5827:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1787841870.434766:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.101@tcp lock: ffff92cbc149ce00/0xe3dac0c99affdfc0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xe3dac0c99affdfc7 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841870.434771:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787841870.434776:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.101@tcp lock: ffff92cbc149ce00/0xe3dac0c99affdfc0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xe3dac0c99affdfc7 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841870.434787:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.101@tcp lock: ffff92cbc149ce00/0xe3dac0c99affdfc0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xe3dac0c99affdfc7 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841870.434799:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841870.434800:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841870.434802:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787841870.434823:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff3d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3298:1874687715007616:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787841870.434913:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841870.434966:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787841870.434973:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff3d30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3298:1874687715007744:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787841870.434996:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841870.435026:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715007616 00000100:00100000:2.0:1787841870.435032:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715007616 00000100:00100000:2.0:1787841870.435081:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715007744 00000100:00100000:2.0:1787841870.435085:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715007744 00000100:00100000:2.0:1787841870.435110:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787841870.435118:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff3d2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+19:3298:x1874687715007616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787841870.435133:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787841870.435149:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92cc00d9ce00/0xe3dac0c99affe507 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe3dac0c99affe500 expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841870.435162:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787841870.435197:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff3d2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+18:3298:x1874687715007616:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841870.435204:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787841870.435226:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787841870.435232:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff3d0b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+17:3298:x1874687715007744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787841870.435246:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787841870.435255:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92cbc13a2a00/0xe3dac0c99affdfc7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe3dac0c99affdfc0 expref: 17 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841870.435267:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787841870.435290:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff3d0b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f6e7591a-84a0-4774-9d28-b3ed28591dc5+16:3298:x1874687715007744:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841870.435296:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:2.0:1787841870.435315:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787841870.435341:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff3d30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3298:1874687715007744:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787841870.435349:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff3d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3298:1874687715007616:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787841870.435977:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff3d3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3300:1874687715007360:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787841870.436011:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841870.436041:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787841870.436047:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff3d1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3300:1874687715007488:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787841870.436065:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841870.436138:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715007360 00000100:00100000:2.0:1787841870.436143:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715007360 00000100:00100000:2.0:1787841870.436179:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715007488 00000100:00100000:2.0:1787841870.436182:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715007488 00000100:00100000:2.0:1787841870.436195:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787841870.436202:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac26de1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+17:3300:x1874687715007360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787841870.436210:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787841870.436224:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92cbc169a600/0xe3dac0c99affe2fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe3dac0c99affe2f3 expref: 17 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841870.436235:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787841870.436270:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac26de1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+16:3300:x1874687715007360:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841870.436277:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787841870.436291:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787841870.436297:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac26dcf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+15:3300:x1874687715007488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787841870.436313:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787841870.436322:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92cbc6724e00/0xe3dac0c99affe213 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe3dac0c99affe20c expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841870.436334:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787841870.436357:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac26dcf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f6e7591a-84a0-4774-9d28-b3ed28591dc5+14:3300:x1874687715007488:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841870.436363:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787841870.436542:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac26dd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1874687715007104:0@lo:9:umount.0 00000100:00100000:1.0:1787841870.436578:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841870.436599:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac26dda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1874687715007232:0@lo:9:umount.0 00000100:00100000:1.0:1787841870.436619:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841870.436646:0:12388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715007104 00000100:00100000:1.0:1787841870.436649:0:12388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715007104 00000100:00100000:0.0:1787841870.436733:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff3d1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3300:1874687715007488:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787841870.436740:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff3d3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3300:1874687715007360:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787841870.436803:0:12388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715007232 00000100:00100000:1.0:1787841870.436806:0:12388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715007232 00000100:00100000:1.0:1787841870.436847:0:12388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787841870.436855:0:12388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3297:x1874687715007104:12345-0@lo:9:umount.0 00000020:00000080:1.0:1787841870.436878:0:12388:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe3dac0c99affe164 00000100:00080000:1.0:1787841870.436886:0:12388:0:(import.c:65:import_set_state_nolock()) ffff92cbffa05800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787841870.436931:0:12388:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:1.0:1787841870.437267:0:12388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+2:3297:x1874687715007104:12345-0@lo:9:umount.0 Request processed in 413us (687us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841870.437275:0:12388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787841870.437385:0:12388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787841870.437395:0:12388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e2e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3297:x1874687715007232:12345-0@lo:9:umount.0 00000020:00000080:1.0:1787841870.437409:0:12388:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe3dac0c99affe23d 00000100:00080000:1.0:1787841870.437415:0:12388:0:(import.c:65:import_set_state_nolock()) ffff92cac12d4800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787841870.437447:0:12388:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:1.0:1787841870.437649:0:12388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e2e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+2:3297:x1874687715007232:12345-0@lo:9:umount.0 Request processed in 255us (1027us total) trans 0 rc 0/0 00000020:00000080:3.0:1787841870.437761:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff92cbcd856800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1787841870.437811:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff92cbf71ac000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1787841870.437845:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff92cbc8b75000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1787841870.437865:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92cbcd857000 for lustre-MDT0000 00000020:00000080:3.0:1787841870.437869:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92cbf71ae000 for lustre-MDT0000 00000020:00000080:3.0:1787841870.437873:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92cbffa02000 for lustre-MDT0000 00010000:00010000:0.0:1787841870.437953:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787841870.439619:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787841870.439626:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787841870.446375:0:12388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787841870.446387:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac30921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3299:1874687715006976:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787841870.446807:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787841870.447949:0:3297:0:(import.c:65:import_set_state_nolock()) ffff92cbff5b2800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1787841870.447973:0:3297:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1787841870.447976:0:3297:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787841870.447981:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac26dd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1874687715007104:0@lo:9:umount.0 00000100:00080000:2.0:1787841870.447998:0:3297:0:(import.c:65:import_set_state_nolock()) ffff92cbffa70000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1787841870.448112:0:3297:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1787841870.454577:0:3297:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787841870.454600:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac26dda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1874687715007232:0@lo:9:umount.0 00000020:00080000:2.0:1787841870.459858:0:12925:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff92cbf7360000) has no exports 00000020:00000080:2.0:1787841870.533661:0:12925:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe3dac0c99affe01b 00000020:00000080:2.0:1787841870.533681:0:12925:0:(genops.c:885:class_export_put()) final put ffff92cbf04e4000/lustre-QMT0000_UUID 00000020:01000000:2.0:1787841870.533833:0:12925:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1787841870.534412:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff92cbf04e4000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1787841870.534446:0:12925:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787841870.534456:0:12925:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787841870.534461:0:12925:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff92cbe9a6b490) has no exports 00000020:00000080:0.0:1787841870.538165:0:12925:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe3dac0c99affe014 00000020:00000080:0.0:1787841870.538183:0:12925:0:(genops.c:885:class_export_put()) final put ffff92cc01d36000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787841870.538269:0:12925:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787841870.538282:0:12925:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1787841870.538286:0:12925:0:(genops.c:885:class_export_put()) final put ffff92cc01d30800/lustre-QMT0000_UUID 00000020:00000080:0.0:1787841870.538290:0:12925:0:(genops.c:844:class_export_destroy()) destroying export ffff92cc01d30800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1787841870.538295:0:12925:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:2.0:1787841870.538492:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff92cc01d36000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1787841870.538569:0:12925:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff92cbff48e060 - data ffff92cbea437ca8/ffff92cbff4f1800 00000020:01000000:0.0:1787841870.538767:0:12925:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff92cbc61a7a20 - data ffff92cbea44d0d8/ffff92cbf8eaec00 00000001:00000004:1.0:1787841870.563796:0:12925:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000001:00100000:2.0:1787841870.640794:0:7643:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787841870.640805:0:7643:0:(genops.c:885:class_export_put()) final put ffff92cac12d1800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787841870.641036:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff92cac12d1800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1787841870.641098:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92cac12d4800 for lustre-OST0001 00000100:00080000:2.0:1787841870.656084:0:12925:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787841870.656093:0:12925:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:2.0:1787841870.656105:0:12925:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787841870.656108:0:12925:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1787841870.656932:0:6713:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1787841870.656938:0:6713:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:3.0:1787841870.656948:0:6713:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1787841870.658363:0:12925:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787841870.658370:0:12925:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1787841870.658393:0:12925:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787841870.658397:0:12925:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1787841870.660180:0:7996:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1787841870.660188:0:7996:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:3.0:1787841870.660200:0:7996:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1787841870.746233:0:12925:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe3dac0c99affdfe3 00000020:00000080:0.0:1787841870.746250:0:12925:0:(genops.c:885:class_export_put()) final put ffff92cbf7355800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787841870.747185:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff92cbf7355800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787841870.748443:0:12925:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe3dac0c99affdff8 00000020:00000080:0.0:1787841870.748453:0:12925:0:(genops.c:885:class_export_put()) final put ffff92cbf736a000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1787841870.748504:0:12925:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1787841870.748511:0:12925:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787841870.748520:0:12925:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787841870.748524:0:12925:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff92cbf7364ed8) has no exports 00000004:01000000:0.0:1787841870.748727:0:12925:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1787841870.748735:0:12925:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe3dac0c99affe236 00000020:00000080:0.0:1787841870.748740:0:12925:0:(genops.c:885:class_export_put()) final put ffff92cbf71ab800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787841870.749193:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff92cbf736a000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1787841870.749301:0:12925:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1787841870.749306:0:12925:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787841870.749313:0:12925:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787841870.749317:0:12925:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff92cbf8e24ed8) has no exports 00000020:00000080:0.0:1787841870.749324:0:12925:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe3dac0c99affe22f 00000020:00000080:0.0:1787841870.749329:0:12925:0:(genops.c:885:class_export_put()) final put ffff92cac315f000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787841870.749349:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff92cbf71ab800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:0.0:1787841870.749981:0:12925:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1787841870.749987:0:12925:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787841870.749991:0:12925:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:0.0:1787841870.750006:0:12925:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787841870.750009:0:12925:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787841870.750393:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff92cac315f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787841870.750475:0:12925:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787841870.750484:0:12925:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787841870.750490:0:12925:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe3dac0c99affe141 00000020:00000080:0.0:1787841870.750496:0:12925:0:(genops.c:885:class_export_put()) final put ffff92cbff856000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787841870.750796:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92cbffa70000 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1787841870.750802:0:36:0:(genops.c:885:class_export_put()) final put ffff92cac3159000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787841870.750804:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff92cac3159000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1787841870.750809:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1787841870.750946:0:12925:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1787841870.750955:0:12925:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787841870.750960:0:12925:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787841870.750967:0:12925:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff92cbffa43490) has no exports 00000020:00000080:0.0:1787841870.750973:0:12925:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe3dac0c99affe13a 00000020:00000080:0.0:1787841870.750979:0:12925:0:(genops.c:885:class_export_put()) final put ffff92cbff5fc000/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1787841870.751482:0:12925:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1787841870.751488:0:12925:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787841870.751491:0:12925:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:0.0:1787841870.751496:0:12925:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787841870.751499:0:12925:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787841870.751531:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff92cbff856000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1787841870.751538:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff92cbff5fc000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787841870.752040:0:12925:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787841870.752051:0:12925:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787841870.752086:0:12925:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787841870.752089:0:12925:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787841870.752094:0:12925:0:(genops.c:885:class_export_put()) final put ffff92cbf7353000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787841870.752097:0:12925:0:(genops.c:844:class_export_destroy()) destroying export ffff92cbf7353000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1787841870.752105:0:12925:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787841870.752299:0:12925:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe3dac0c99affdfff 00000020:00000080:0.0:1787841870.752306:0:12925:0:(genops.c:885:class_export_put()) final put ffff92cbf7369800/lustre-MDD0000_UUID 00000020:00000080:3.0:1787841870.752395:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92cbff5b2800 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1787841870.752402:0:36:0:(genops.c:885:class_export_put()) final put ffff92cbff5fc800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787841870.752404:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff92cbff5fc800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1787841870.752408:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1787841870.752908:0:12925:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1787841870.752913:0:12925:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787841870.752919:0:12925:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787841870.752923:0:12925:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff92cbf7361a48) has no exports 00000020:00000080:0.0:1787841870.752944:0:12925:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787841870.752948:0:12925:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1787841870.752953:0:12925:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe3dac0c99affe006 00000020:00000080:0.0:1787841870.752958:0:12925:0:(genops.c:885:class_export_put()) final put ffff92cbf736c800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787841870.752978:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff92cbf7369800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1787841870.752982:0:36:0:(genops.c:885:class_export_put()) final put ffff92cbf7351800/lustre-MDD0000_UUID 00000020:00000080:3.0:1787841870.752984:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff92cbf7351800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1787841870.752988:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:0.0:1787841870.753473:0:12925:0:(tgt_mount.c:187:server_put_mount()) put mount ffff92cbc3ed8000 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1787841870.753479:0:12925:0:(obd_mount.c:710:lustre_put_lsi()) put ffff92cbc3ed8000 3 00000020:01000004:0.0:1787841870.753482:0:12925:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff92cbc3ed8000 from lustre-MDT0000 00000020:00000080:0.0:1787841870.753512:0:12925:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787841870.753517:0:12925:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1787841870.753520:0:12925:0:(genops.c:885:class_export_put()) final put ffff92cbf7351000/lustre-MDT0000_UUID 00000020:00000080:0.0:1787841870.753522:0:12925:0:(genops.c:844:class_export_destroy()) destroying export ffff92cbf7351000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1787841870.753529:0:12925:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1787841870.753559:0:12925:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:0.0:1787841870.753562:0:12925:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1787841870.753576:0:12925:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1787841870.753579:0:12925:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787841870.753582:0:12925:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787841870.753589:0:12925:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff92cbf07dc000 f6e7591a-84a0-4774-9d28-b3ed28591dc5 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00000080:3.0:1787841870.753670:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff92cbf736c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00080000:0.0:1787841870.753692:0:12925:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff92cbe998b490) has exports, disconnecting them 00000020:00080000:0.0:1787841870.753791:0:12925:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff92cbf07dc000), last request at 1787841607 00000020:00000080:0.0:1787841870.753808:0:12925:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe3dac0c99affdfa4 00000020:00010000:0.0:1787841870.753812:0:12925:0:(genops.c:1921:obd_stale_export_put()) Put export ffff92cbf07dc000: total 0 00000100:00080000:0.0:1787841870.753817:0:12925:0:(import.c:65:import_set_state_nolock()) ffff92cbf07de000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787841870.753869:0:12925:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff92cbf07dc000): rc 0 00000020:00080000:0.0:1787841870.753874:0:12925:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff92cbe998b490) has no exports 00000100:00100000:0.0:1787841870.753925:0:5832:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff92cbcd5d5a00:5832] 1 exiting: rc = 0 00000100:00100000:3.0:1787841870.754087:0:5833:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff92cbcd5d5e00:5833] 2 exiting: rc = 0 00000020:00010000:2.0:1787841870.754192:0:5826:0:(genops.c:1907:obd_stale_export_get()) Get export ffff92cbf07dc000: total 0 00010000:00010000:2.0:1787841870.754225:0:5826:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff92cbf07dc000, canceled 0 locks, left on hash table 8. 00010000:00010000:2.0:1787841870.754254:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92cbc169a200/0xe3dac0c99affe4f9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe3dac0c99affe4f2 expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841870.754270:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92cbc169be00/0xe3dac0c99affe2de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe3dac0c99affe2d7 expref: 8 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841870.754280:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92cbc13a2e00/0xe3dac0c99affe0ae lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe3dac0c99affe0a7 expref: 7 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841870.754293:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92cc00d9cc00/0xe3dac0c99affe4eb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe3dac0c99affe4e4 expref: 6 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841870.754305:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92cbc149c200/0xe3dac0c99affe308 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe3dac0c99affe301 expref: 5 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841870.754315:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92cbc6725e00/0xe3dac0c99affe2b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe3dac0c99affe2ad expref: 4 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841870.754325:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92cbc6598400/0xe3dac0c99affe2c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe3dac0c99affe2bb expref: 3 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841870.754335:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92cbc149c600/0xe3dac0c99affe2d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe3dac0c99affe2c9 expref: 2 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841870.754358:0:5826:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff92cbf07dc000, canceled 8 locks, left on hash table 0. 00000020:00000080:2.0:1787841870.754368:0:5826:0:(genops.c:885:class_export_put()) final put ffff92cbf07dc000/f6e7591a-84a0-4774-9d28-b3ed28591dc5 00010000:00010000:2.0:1787841870.754409:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841870.754411:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841870.754413:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787841870.754431:0:5831:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff92cbf0521000:5831] 0 exiting: rc = 1 00000100:00100000:0.0:1787841870.754515:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841870.754523:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841870.754530:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841870.754536:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841870.754541:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841870.754547:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841870.754553:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841870.754558:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841870.754563:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841870.754568:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841870.754574:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841870.754580:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841870.754586:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841870.754592:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841870.754607:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841870.754614:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841870.754620:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841870.754625:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841870.754631:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841870.754637:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841870.754643:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841870.754656:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841870.754663:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841870.754669:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841870.754675:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841870.754681:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841870.754686:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841870.754692:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841870.754720:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841870.754726:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841870.754731:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841870.754737:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841870.754742:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841870.754748:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841870.754755:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841870.754761:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841870.754767:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841870.754773:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841870.754778:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841870.754783:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841870.754789:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841870.754794:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841870.754799:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841870.754804:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841870.754808:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841870.754814:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841870.754827:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841870.754834:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841870.754839:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841870.754844:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841870.754849:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841870.754855:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841870.754859:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841870.754864:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841870.754869:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841870.754874:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841870.754888:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841870.754893:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841870.754898:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841870.754903:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841870.754910:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841870.754915:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841870.754920:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841870.754925:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:0.0:1787841870.755451:0:12925:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1787841870.755455:0:12925:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:00000080:3.0:1787841870.756469:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff92cbf07dc000/f6e7591a-84a0-4774-9d28-b3ed28591dc5 for MGS 00000020:00000080:3.0:1787841870.756514:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92cbf07de000 for MGS 00000020:01000000:0.0:1787841870.757197:0:12925:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff92cbf6a075a0 - data ffff92cbea452438/ffff92cbcd416800 00000020:01000000:0.0:1787841870.757323:0:12925:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff92cbf0428ea0 - data ffff92cbf13df870/ffff92cbe9a1c400 00000020:00000080:0.0:1787841870.758372:0:12925:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe3dac0c99affdf88 00000020:00000080:0.0:1787841870.758381:0:12925:0:(genops.c:885:class_export_put()) final put ffff92cbc94de000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1787841870.758396:0:12925:0:(tgt_mount.c:187:server_put_mount()) put mount ffff92cbc3ed8000 from MGS, refs=2 00000020:01000004:0.0:1787841870.758399:0:12925:0:(obd_mount.c:710:lustre_put_lsi()) put ffff92cbc3ed8000 2 00000020:01000004:0.0:1787841870.758402:0:12925:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff92cbc3ed8000 from MGS 00000020:00000080:0.0:1787841870.758426:0:12925:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787841870.758434:0:12925:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1787841870.758436:0:12925:0:(genops.c:885:class_export_put()) final put ffff92cbc94dc000/MGS 00000020:00000080:0.0:1787841870.758438:0:12925:0:(genops.c:844:class_export_destroy()) destroying export ffff92cbc94dc000/MGS for MGS 00000020:01000000:0.0:1787841870.758444:0:12925:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1787841870.758499:0:12925:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1787841870.758504:0:12925:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787841870.758511:0:12925:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787841870.758521:0:12925:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff92cbcd853800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787841870.758528:0:12925:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff92cbf426ced8) has exports, disconnecting them 00000020:00080000:0.0:1787841870.758534:0:12925:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff92cbcd853800), last request at 1787841608 00000020:00000080:0.0:1787841870.758540:0:12925:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe3dac0c99affe053 00000020:00080000:0.0:1787841870.758556:0:12925:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff92cbcd853800): rc 0 00000020:00000080:0.0:1787841870.758561:0:12925:0:(genops.c:885:class_export_put()) final put ffff92cbcd853800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1787841870.758729:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff92cbc94de000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787841870.758742:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff92cbcd853800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1787841870.761764:0:12925:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1787841870.761774:0:12925:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787841870.761778:0:12925:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787841870.761785:0:12925:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787841870.761971:0:12925:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787841870.761980:0:12925:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1787841870.761988:0:12925:0:(obd_mount.c:710:lustre_put_lsi()) put ffff92cbc3ed8000 1 00000020:00000080:2.0:1787841870.761994:0:12925:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe3dac0c99affdf7a 00000020:00000080:2.0:1787841870.762015:0:12925:0:(genops.c:885:class_export_put()) final put ffff92cbc94d8000/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1787841870.762022:0:12925:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1787841870.762027:0:12925:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787841870.762031:0:12925:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787841870.762036:0:12925:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff92cbf4269a48) has no exports 00000020:00000080:3.0:1787841870.764455:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92cbcd850800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1787841870.764473:0:38:0:(genops.c:885:class_export_put()) final put ffff92cbcd850000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1787841870.764478:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff92cbcd850000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1787841870.764486:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1787841870.764557:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff92cbc94d8000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787841870.805461:0:12925:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787841870.805480:0:12925:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1787841870.805487:0:12925:0:(genops.c:885:class_export_put()) final put ffff92cbc3edf800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787841870.805492:0:12925:0:(genops.c:844:class_export_destroy()) destroying export ffff92cbc3edf800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1787841870.805502:0:12925:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1787841870.805642:0:12925:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff92cbc3edc000 00000020:01000000:3.0:1787841870.805664:0:12925:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1787841870.805668:0:12925:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787841870.805673:0:12925:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787841870.805685:0:12925:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff92cbf426b490) has no exports 00000100:00100000:0.0:1787841870.806522:0:5837:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff92cbe9ae2000:5837] 0 exiting: rc = 1 00000100:00100000:0.0:1787841870.806652:0:9449:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff92cbf8e12a00:9449] 3 exiting: rc = 0 00000100:00100000:0.0:1787841870.806760:0:12018:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff92cbf70f3c00:12018] 4 exiting: rc = 0 00000100:00100000:1.0:1787841870.807206:0:5838:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff92cbe987e400:5838] 1 exiting: rc = 0 00000100:00100000:1.0:1787841870.807310:0:5839:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff92cbe987e800:5839] 2 exiting: rc = 0 00000100:00100000:3.0:1787841870.807570:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787841870.807580:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787841870.807586:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787841870.807592:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787841870.807607:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787841870.807614:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787841870.807619:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787841870.807625:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787841870.807630:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787841870.807635:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787841870.807641:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787841870.807646:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787841870.807651:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787841870.807656:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787841870.807661:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787841870.807666:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787841870.807671:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787841870.807677:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787841870.807681:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787841870.807686:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787841870.807692:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787841870.807714:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787841870.807720:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787841870.807725:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787841870.807731:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787841870.807736:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787841870.807741:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787841870.807745:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787841870.807751:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787841870.807755:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787841870.807761:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787841870.807765:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787841870.807771:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787841870.807776:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787841870.807789:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787841870.807795:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787841870.807800:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787841870.807805:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787841870.807811:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787841870.807816:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787841870.807834:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787841870.807839:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787841870.807844:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787841870.807849:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787841870.807854:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787841870.807860:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787841870.807865:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787841870.807870:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787841870.807875:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787841870.807880:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787841870.807886:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787841870.807892:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787841870.807898:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787841870.807904:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787841870.807910:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787841870.807916:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787841870.807922:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787841870.807927:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787841870.807933:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787841870.807952:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787841870.807959:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787841870.807964:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787841870.807970:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787841870.807976:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787841870.815267:0:12373:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_002: service thread [ffff92cbff4c1400:12373] 2 exiting: rc = 0 00000100:00100000:1.0:1787841870.817194:0:5840:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff92cbd0c93e00:5840] 0 exiting: rc = 1 00000100:00100000:0.0:1787841870.820836:0:5841:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff92cbe987fe00:5841] 1 exiting: rc = 0 00000100:00100000:2.0:1787841870.830276:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.830291:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.830298:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.830305:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.830312:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.830328:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.830337:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.830343:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.830351:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.830357:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.830364:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.830386:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.830396:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.830403:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.830410:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.830415:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.830420:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.830426:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.830432:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.830438:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.830445:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.830450:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.830456:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.830461:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.830467:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.830472:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.830478:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.830483:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.830489:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.830495:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.830501:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.830508:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.830513:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.830519:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.830525:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.830531:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.830537:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.830544:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.830550:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.830556:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.830560:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.830566:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.830571:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.830577:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.830584:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.830589:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.830602:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.830607:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.830612:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.830619:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.830625:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.830631:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.830635:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.830640:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.830645:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.830651:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.830656:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.830661:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.830666:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.830672:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.830677:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.830683:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.830689:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.830694:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.834568:0:5843:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff92cbd0c93800:5843] 1 exiting: rc = 0 00000100:00100000:2.0:1787841870.837665:0:5842:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff92cbcda33800:5842] 0 exiting: rc = 1 00000100:00100000:2.0:1787841870.837849:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.837860:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.837867:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.837873:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.837881:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.837888:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.837896:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.837902:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.837911:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.837917:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.837924:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.837930:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.837939:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.837978:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.837987:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.838015:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.838021:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.838027:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.838033:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.838039:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.838047:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.838055:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.838064:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.838070:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.838076:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.838099:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.838107:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.838114:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.838122:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.838129:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.838137:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.838145:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.838152:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.838158:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.838165:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.838171:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.838178:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.838201:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.838211:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.838218:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.838225:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.838231:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.838237:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.838244:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.838250:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.838257:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.838264:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.838270:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.838278:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.838300:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.838314:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.838321:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.838328:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.838334:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.838340:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.838347:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.838354:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.838360:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.838367:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.838374:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.838381:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.838388:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.838395:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.838409:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787841870.851068:0:5845:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff92cbcda32200:5845] 1 exiting: rc = 0 00000100:00100000:2.0:1787841870.851531:0:5844:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff92cbcda32600:5844] 0 exiting: rc = 1 00000100:00100000:2.0:1787841870.851665:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.851675:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.851680:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.851685:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.851691:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.851722:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.851729:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.851734:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.851739:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.851745:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.851751:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.851756:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.851762:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.851768:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.851773:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.851779:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.851784:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.851790:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.851795:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.851800:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.851833:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.851838:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.851843:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.851849:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.851854:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.851860:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.851866:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.851871:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.851877:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.851882:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.851888:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.851893:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.851898:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.851905:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.851912:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.851917:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.851923:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.851927:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.851933:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.851939:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.851945:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.851950:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.851954:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.851959:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.851965:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.851970:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.851976:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.851981:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.851986:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.851990:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.852104:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.852112:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.852118:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.852123:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.852129:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.852143:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.852149:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.852155:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.852161:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.852167:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.852172:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.852177:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.852183:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.852189:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787841870.853217:0:5847:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff92cbcda32000:5847] 1 exiting: rc = 0 00000100:00100000:2.0:1787841870.853460:0:5846:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff92cbcda33600:5846] 0 exiting: rc = 1 00000100:00100000:2.0:1787841870.853522:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.853529:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.853535:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.853541:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.853547:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.853553:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.853558:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.853564:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.853570:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.853577:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.853583:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.853589:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.853667:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.853677:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.853683:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.853689:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.853734:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.853741:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.853747:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.853753:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.853758:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.853765:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.853772:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.853778:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.853784:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.853804:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.853809:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.853815:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.853831:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.853837:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.853844:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.853849:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.853855:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.853860:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.853866:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.853872:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.853878:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.853884:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.853889:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.853894:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.853900:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.853905:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.853910:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.853915:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.853921:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.853926:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.853931:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.853936:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.853941:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.853947:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.853952:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.853958:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.853963:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.853967:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.853972:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.853978:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.853983:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.853989:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.854107:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.854115:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.854130:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.854136:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.854142:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.854147:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787841870.855282:0:5849:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff92cbe9a96e00:5849] 1 exiting: rc = 0 00000100:00100000:3.0:1787841870.855376:0:5848:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff92cbe9a97000:5848] 0 exiting: rc = 1 00000100:00100000:2.0:1787841870.855495:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.855502:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.855509:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.855514:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.855519:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.855524:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.855529:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.855534:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.855539:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.855544:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.855549:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.855555:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.855562:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.855567:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.855572:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.855577:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.855583:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.855587:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.855593:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.855612:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.855617:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.855622:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.855629:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.855635:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.855642:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.855647:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.855653:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.855659:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.855666:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.855671:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.855676:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.855691:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.855724:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.855732:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.855738:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.855743:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.855749:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.855756:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.855762:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.855767:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.855773:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.855779:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.855785:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.855791:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.855798:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.855804:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.855809:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.855814:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.855831:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.855836:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.855842:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.855848:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.855853:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.855859:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.855864:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.855870:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.855875:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.855880:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.855887:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.855892:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.855898:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.855904:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.855909:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.855915:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.856587:0:5851:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff92cbe9a9dc00:5851] 1 exiting: rc = 0 00000100:00100000:3.0:1787841870.857432:0:5850:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff92cbef61ea00:5850] 0 exiting: rc = 1 00000100:00100000:3.0:1787841870.857866:0:5852:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff92cbef5c3800:5852] 2 exiting: rc = 0 00000100:00100000:2.0:1787841870.858189:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.858211:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.858219:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.858225:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.858234:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.858241:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.858248:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.858254:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.858260:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.858267:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.858275:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.858283:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.858289:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.858295:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.858301:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.858308:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.858314:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.858320:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.858342:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.858349:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.858356:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.858363:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.858371:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.858379:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.858387:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.858393:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.858400:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.858407:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.858415:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.858422:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.858428:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.858435:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.858441:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.858451:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.858460:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.858467:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.858484:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.858491:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.858498:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.858507:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.858518:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.858524:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.858547:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.858554:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.858561:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.858567:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.858573:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.858584:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.858591:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.858730:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.858739:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.858746:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.858752:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.858758:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.858765:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.858771:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.858778:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.858785:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.858792:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.858799:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.858807:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.858814:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.858833:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841870.858849:0:12925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1787841870.868120:0:12925:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787841870.868140:0:12925:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1787841870.868147:0:12925:0:(genops.c:885:class_export_put()) final put ffff92cbc9416800/MDS_uuid 00000020:00000080:2.0:1787841870.868152:0:12925:0:(genops.c:844:class_export_destroy()) destroying export ffff92cbc9416800/MDS_uuid for MDS 00000020:01000000:2.0:1787841870.868160:0:12925:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1787841870.868296:0:12925:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1787841871.428645:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787841872.129145:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac3093480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1874687715008128:0@lo:400:kworker.0 00000400:00000100:2.0:1787841872.129238:0:3298:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874687715008128 offset 0 length 224: 4 00000100:00100000:1.0:1787841872.129578:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac3090f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1874687715008000:0@lo:400:kworker.0 00000400:00000100:1.0:1787841872.129610:0:3301:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874687715008000 offset 0 length 224: 4 00000100:00100000:1.0:1787841872.129627:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787841872.129633:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac3093c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3301:1874687715007872:0@lo:400:kworker.0 00000400:00000100:1.0:1787841872.129654:0:3301:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874687715007872 offset 0 length 224: 4 00010000:00010000:2.0:1787841872.454349:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841873.472973:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787841874.082633:0:13075:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1787841874.098805:0:13075:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1787841874.098856:0:13075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc6725000/0xe3dac0c99affe2c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe2d0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841874.098870:0:13075:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc6725000/0xe3dac0c99affe2c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xe3dac0c99affe2d0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841874.098877:0:13075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc6725000/0xe3dac0c99affe2c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xe3dac0c99affe2d0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841874.098884:0:13075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.101@tcp lock: ffff92cbc6725000/0xe3dac0c99affe2c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xe3dac0c99affe2d0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841874.098904:0:13075:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787841874.098910:0:13075:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1787841874.098935:0:13075:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787841874.098948:0:13075:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff92cac3090f00 x1874687715008000/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787841888 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787841874.098968:0:13075:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787841874.098974:0:13075:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787841874.099001:0:13075:0:(import.c:65:import_set_state_nolock()) ffff92cbf7350000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1787841874.099310:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac3090f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1874687715008000:0@lo:400:kworker.0 00010000:00010000:2.0:1787841874.099423:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787841874.099431:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.101@tcp lock: ffff92cbc6725000/0xe3dac0c99affe2c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xe3dac0c99affe2d0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841874.099439:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6725000 already unused, calling callback (ffffffffc1d9fc20) 10000000:00010000:2.0:1787841874.099443:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.101@tcp lock: ffff92cbc6725000/0xe3dac0c99affe2c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xe3dac0c99affe2d0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841874.099453:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.101@tcp lock: ffff92cbc6725000/0xe3dac0c99affe2c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xe3dac0c99affe2d0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787841874.099460:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.101@tcp lock: ffff92cbc6725000/0xe3dac0c99affe2c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xe3dac0c99affe2d0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787841874.099466:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787841874.099468:0:5826:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1787841874.099470:0:5826:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1787841874.099496:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.101@tcp lock: ffff92cbc6725000/0xe3dac0c99affe2c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xe3dac0c99affe2d0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841874.099502:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787841874.099536:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.101@tcp lock: ffff92cbc6725000/0xe3dac0c99affe2c9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xe3dac0c99affe2d0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841874.099543:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.101@tcp lock: ffff92cbc6725000/0xe3dac0c99affe2c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xe3dac0c99affe2d0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841874.099570:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841874.099572:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841874.099574:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787841874.099588:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac3093840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3297:1874687715008256:0@lo:39:umount.0 00000400:00000100:2.0:1787841874.099646:0:3297:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874687715008256 offset 0 length 224: 4 00000100:00100000:1.0:1787841874.099989:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787841874.100000:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff3d30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3298:1874687715008384:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787841874.100035:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841874.100158:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715008384 00000100:00100000:2.0:1787841874.100165:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715008384 00000100:00100000:2.0:1787841874.100212:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787841874.100219:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e2fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3298:x1874687715008384:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1787841874.100225:0:5824:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787841874 with bad export cookie 16418647363653984164 00000100:00100000:3.0:1787841874.122159:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e2fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3298:x1874687715008384:12345-0@lo:103:ldlm_bl.0 Request processed in 21929us (22112us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787841874.122175:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1787841874.124188:0:3298:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.101@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787841874.124196:0:3298:0:(import.c:65:import_set_state_nolock()) ffff92cbc2e3e800 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1787841874.124201:0:3298:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.101@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1787841874.142656:0:3298:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.101@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1787841874.142663:0:3298:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1787841874.142672:0:3298:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff92cac3093c00 x1874687715007872/t0(0) o400->MGC192.168.201.101@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787841888 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787841874.142758:0:3298:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff92cbff3d30c0 x1874687715008384/t0(0) o103->MGC192.168.201.101@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787841890 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1787841874.142779:0:3298:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1787841874.142802:0:3298:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1787841874.142804:0:3298:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1787841874.142809:0:3298:0:(import.c:65:import_set_state_nolock()) ffff92cbc2e3e800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787841874.142814:0:3298:0:(import.c:510:import_select_connection()) MGC192.168.201.101@tcp: connect to NID 0@lo last attempt 147 00000100:00080000:1.0:1787841874.142826:0:3298:0:(import.c:624:import_select_connection()) MGC192.168.201.101@tcp: import ffff92cbc2e3e800 using connection 192.168.201.101@tcp/0@lo 00000100:00100000:1.0:1787841874.143194:0:3298:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92cbf6e2f480 x1874687715008512/t0(0) o250->MGC192.168.201.101@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787841874.143226:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3297:1874687715008512:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:1.0:1787841874.143279:0:3297:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874687715008512 offset 0 length 520: 4 00000100:00100000:1.0:1787841874.143340:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff3d30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3298:1874687715008384:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787841874.144008:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac3093c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3301:1874687715007872:0@lo:400:kworker.0 00000001:00100000:2.0:1787841874.238137:0:6717:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787841874.238147:0:6717:0:(genops.c:885:class_export_put()) final put ffff92cbffa06000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787841874.238224:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff92cbffa06000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1787841874.238278:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92cbffa05800 for lustre-OST0000 00010000:00010000:2.0:1787841874.497005:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841875.522734:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841876.547620:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787841877.251757:0:12628:0:(pinger.c:229:ptlrpc_pinger_process_import()) f6e7591a-84a0-4774-9d28-b3ed28591dc5->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787841877.251773:0:12628:0:(pinger.c:247:ptlrpc_pinger_process_import()) f6e7591a-84a0-4774-9d28-b3ed28591dc5->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787841877.251889:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787841877.251912:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff3d2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1874687715008640:0@lo:400:kworker.0 00000400:00000100:2.0:1787841877.251981:0:3301:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874687715008640 offset 0 length 224: 4 00010000:00010000:2.0:1787841877.571504:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841878.594065:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787841879.296951:0:12628:0:(pinger.c:229:ptlrpc_pinger_process_import()) f6e7591a-84a0-4774-9d28-b3ed28591dc5->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787841879.296962:0:12628:0:(pinger.c:247:ptlrpc_pinger_process_import()) f6e7591a-84a0-4774-9d28-b3ed28591dc5->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787841879.297208:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff3d03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1874687715008768:0@lo:400:kworker.0 00000400:00000100:3.0:1787841879.297289:0:3301:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874687715008768 offset 0 length 224: 4 00010000:00010000:2.0:1787841879.620142:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841880.641282:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841881.665578:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841882.692156:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841883.717737:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787841884.417508:0:3297:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787841874/real 1787841874] req@ffff92cbf6e2f480 x1874687715008512/t0(0) o250->MGC192.168.201.101@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787841884 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787841884.417563:0:3297:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff92cbf6e2f480 x1874687715008512/t0(0) o250->MGC192.168.201.101@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787841884 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787841884.417577:0:3297:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787841874/real 1787841874] req@ffff92cac3093840 x1874687715008256/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787841884 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787841884.417603:0:3297:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff92cac3093840 x1874687715008256/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787841884 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787841884.417636:0:3297:0:(import.c:65:import_set_state_nolock()) ffff92cbc2e3e800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787841884.417672:0:3297:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1787841884.417677:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3297:1874687715008512:0@lo:250:ptlrpcd_00_00.0 00000100:00080000:0.0:1787841884.417685:0:3297:0:(import.c:65:import_set_state_nolock()) ffff92cbf7350000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1787841884.417728:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac3093840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3297:1874687715008256:0@lo:39:umount.0 00000100:00080000:3.0:1787841884.417884:0:13075:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787841884.417892:0:13075:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787841884.417898:0:13075:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1787841884.419270:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) f6e7591a-84a0-4774-9d28-b3ed28591dc5->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787841884.419282:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1787841884.419295:0:36:0:(import.c:65:import_set_state_nolock()) ffff92cbc2e3e800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787841884.419306:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.101@tcp: connect to NID 0@lo last attempt 414 00000100:00080000:2.0:1787841884.419314:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.101@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787841884.419324:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.101@tcp: import ffff92cbc2e3e800 using connection 192.168.201.101@tcp/0@lo 00000100:00100000:2.0:1787841884.419381:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92cbff3d2d00 x1874687715008896/t0(0) o250->MGC192.168.201.101@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787841884.419446:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff3d2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3297:1874687715008896:0@lo:250:kworker.0 00000100:00100000:2.0:1787841884.419462:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787841884.419473:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff3d12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1874687715009024:0@lo:400:kworker.0 00000400:00000100:2.0:1787841884.420406:0:3299:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874687715009024 offset 0 length 224: 4 00010000:00010000:3.0:1787841884.420841:0:13075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc169b800/0xe3dac0c99affe2d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe2de expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841884.420859:0:13075:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc169b800/0xe3dac0c99affe2d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe3dac0c99affe2de expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841884.420866:0:13075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc169b800/0xe3dac0c99affe2d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xe3dac0c99affe2de expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841884.420875:0:13075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.101@tcp lock: ffff92cbc169b800/0xe3dac0c99affe2d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xe3dac0c99affe2de expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841884.420896:0:13075:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787841884.420906:0:13075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc6724000/0xe3dac0c99affe4f2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe4f9 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841884.420913:0:13075:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc6724000/0xe3dac0c99affe4f2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe3dac0c99affe4f9 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841884.420920:0:13075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc6724000/0xe3dac0c99affe4f2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe3dac0c99affe4f9 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841884.420926:0:13075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.101@tcp lock: ffff92cbc6724000/0xe3dac0c99affe4f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe3dac0c99affe4f9 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841884.420948:0:13075:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1787841884.420976:0:13075:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1787841884.421008:0:13075:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1787841884.421014:0:13075:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1787841884.421019:0:13075:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787841884.421027:0:13075:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787841884.421032:0:13075:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff92cbf7363490) has no exports 00000020:00080000:3.0:1787841884.421071:0:13075:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff92cbf7363490) has no exports 00010000:00010000:2.0:1787841884.422416:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787841884.422436:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.101@tcp lock: ffff92cbc169b800/0xe3dac0c99affe2d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xe3dac0c99affe2de expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841884.422452:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc169b800 already unused, calling callback (ffffffffc1d9fc20) 10000000:00010000:2.0:1787841884.422459:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.101@tcp lock: ffff92cbc169b800/0xe3dac0c99affe2d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xe3dac0c99affe2de expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841884.422473:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.101@tcp lock: ffff92cbc169b800/0xe3dac0c99affe2d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xe3dac0c99affe2de expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787841884.422483:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.101@tcp lock: ffff92cbc169b800/0xe3dac0c99affe2d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xe3dac0c99affe2de expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787841884.422523:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787841884.422527:0:5827:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:2.0:1787841884.422531:0:5827:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1787841884.422655:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787841884.423718:0:5827:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff92cbc2e3e800 00010000:00010000:2.0:1787841884.424420:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.101@tcp lock: ffff92cbc169b800/0xe3dac0c99affe2d7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xe3dac0c99affe2de expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841884.424432:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.101@tcp lock: ffff92cbc169b800/0xe3dac0c99affe2d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xe3dac0c99affe2de expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841884.424456:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841884.424459:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841884.424462:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841884.426276:0:13078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841884.426301:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.101@tcp lock: ffff92cbc6724000/0xe3dac0c99affe4f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe3dac0c99affe4f9 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841884.426314:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6724000 already unused, calling callback (ffffffffc1d9fc20) 10000000:00010000:1.0:1787841884.426320:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.101@tcp lock: ffff92cbc6724000/0xe3dac0c99affe4f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe3dac0c99affe4f9 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841884.426331:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.101@tcp lock: ffff92cbc6724000/0xe3dac0c99affe4f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xe3dac0c99affe4f9 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787841884.426340:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.101@tcp lock: ffff92cbc6724000/0xe3dac0c99affe4f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xe3dac0c99affe4f9 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787841884.426348:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787841884.426374:0:5826:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1787841884.426378:0:5826:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1787841884.426398:0:5826:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff92cbc2e3e800 00010000:00010000:1.0:1787841884.426403:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.101@tcp lock: ffff92cbc6724000/0xe3dac0c99affe4f2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xe3dac0c99affe4f9 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841884.426410:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.101@tcp lock: ffff92cbc6724000/0xe3dac0c99affe4f2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xe3dac0c99affe4f9 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841884.426431:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841884.426433:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841884.426436:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841884.426441:0:13078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841884.426443:0:13078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:0.0:1787841884.427788:0:3297:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874687715008896 offset 0 length 520: 4 00000020:01000000:3.0:1787841884.430467:0:13075:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff92cbff48eae0 - data ffff92cbffc96948/ffff92cbff4f0800 00000020:01000000:3.0:1787841884.434441:0:13075:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff92cbc52e80c0 - data ffff92cbf13c0360/ffff92cbff8b4400 00100000:10000000:3.0:1787841884.453769:0:13075:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1787841884.505669:0:13075:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe3dac0c99affe0ca 00000020:00000080:2.0:1787841884.505683:0:13075:0:(genops.c:885:class_export_put()) final put ffff92cbff5fe000/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1787841884.506493:0:13075:0:(tgt_mount.c:187:server_put_mount()) put mount ffff92cbf04e3800 from lustre-OST0000, refs=2 00000020:01000004:2.0:1787841884.506501:0:13075:0:(obd_mount.c:710:lustre_put_lsi()) put ffff92cbf04e3800 2 00000020:01000004:2.0:1787841884.506505:0:13075:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff92cbf04e3800 from lustre-OST0000 00000020:00000080:2.0:1787841884.506553:0:13075:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787841884.506569:0:13075:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1787841884.506574:0:13075:0:(genops.c:885:class_export_put()) final put ffff92cbff5ff800/lustre-OST0000_UUID 00000020:00000080:2.0:1787841884.506578:0:13075:0:(genops.c:844:class_export_destroy()) destroying export ffff92cbff5ff800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1787841884.506598:0:13075:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1787841884.506679:0:13075:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1787841884.506685:0:13075:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1787841884.506691:0:13075:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787841884.506756:0:13075:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787841884.506767:0:13075:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff92cbc8b72000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787841884.506774:0:13075:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff92cbe9989a48) has exports, disconnecting them 00000020:00080000:2.0:1787841884.506803:0:13075:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff92cbc8b72000), last request at 1787841626 00000020:00000080:2.0:1787841884.506810:0:13075:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe3dac0c99affe0f4 00000020:00080000:2.0:1787841884.506829:0:13075:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff92cbc8b72000): rc 0 00000020:00000080:2.0:1787841884.506835:0:13075:0:(genops.c:885:class_export_put()) final put ffff92cbc8b72000/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1787841884.507477:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff92cbff5fe000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1787841884.507496:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff92cbc8b72000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:3.0:1787841884.509247:0:13075:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1787841884.509259:0:13075:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787841884.509265:0:13075:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787841884.509274:0:13075:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787841884.509566:0:13075:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787841884.509588:0:13075:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:3.0:1787841884.509598:0:13075:0:(obd_mount.c:710:lustre_put_lsi()) put ffff92cbf04e3800 1 00000020:00000080:3.0:1787841884.509609:0:13075:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe3dac0c99affe084 00000020:00000080:3.0:1787841884.509620:0:13075:0:(genops.c:885:class_export_put()) final put ffff92cbc8b70000/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1787841884.509628:0:13075:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1787841884.509637:0:13075:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787841884.509643:0:13075:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787841884.509648:0:13075:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff92cbe998ced8) has no exports 00000020:00000080:1.0:1787841884.509875:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92cbf7350000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1787841884.509886:0:36:0:(genops.c:885:class_export_put()) final put ffff92cbff5b0800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1787841884.509889:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff92cbff5b0800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1787841884.509900:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1787841884.510007:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff92cbc8b70000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1787841884.546778:0:13075:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787841884.546805:0:13075:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1787841884.546813:0:13075:0:(genops.c:885:class_export_put()) final put ffff92cbf04e5000/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1787841884.546819:0:13075:0:(genops.c:844:class_export_destroy()) destroying export ffff92cbf04e5000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1787841884.546836:0:13075:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1787841884.547054:0:13075:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff92cbf04e1800 00000020:02000400:1.0:1787841884.547808:0:13075:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1787841884.740860:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841885.760994:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841886.787294:0:13078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841887.809004:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:0.0:1787841888.515906:0:3298:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787841872/real 1787841872] req@ffff92cac3093480 x1874687715008128/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787841888 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787841888.564412:0:3298:0:(client.c:2547:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff92cac3093480 x1874687715008128/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787841888 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787841888.564433:0:3298:0:(import.c:65:import_set_state_nolock()) ffff92cbf71ae800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1787841888.564451:0:3298:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1787841888.579372:0:3298:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0000_UUID: waking up pinger s:DISCONN 00000100:00080000:2.0:1787841888.580112:0:12628:0:(pinger.c:229:ptlrpc_pinger_process_import()) f6e7591a-84a0-4774-9d28-b3ed28591dc5->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787841888.580118:0:12628:0:(pinger.c:247:ptlrpc_pinger_process_import()) f6e7591a-84a0-4774-9d28-b3ed28591dc5->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787841888.580121:0:12628:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787841888.580124:0:12628:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787841888.580128:0:12628:0:(import.c:65:import_set_state_nolock()) ffff92cbf71ae800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787841888.580135:0:12628:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 186 00000100:00080000:2.0:1787841888.580144:0:12628:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff92cbf71ae800 using connection 192.168.201.101@tcp/0@lo 00000100:00100000:2.0:1787841888.580175:0:12628:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92cbff3d0780 x1874687715009152/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787841888.580226:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac3093480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1874687715008128:0@lo:400:kworker.0 00000100:00100000:0.0:1787841888.582488:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff3d0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3297:1874687715009152:0@lo:38:kworker.0 00000400:00000100:0.0:1787841888.582558:0:3297:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874687715009152 offset 0 length 520: 4 00000020:01000004:0.0:1787841888.703901:0:13228:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1787841888.721843:0:13228:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1787841888.721920:0:13228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc169aa00/0xe3dac0c99affe2ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe2b4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841888.721936:0:13228:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc169aa00/0xe3dac0c99affe2ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe3dac0c99affe2b4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841888.721944:0:13228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc169aa00/0xe3dac0c99affe2ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xe3dac0c99affe2b4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841888.721952:0:13228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.101@tcp lock: ffff92cbc169aa00/0xe3dac0c99affe2ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xe3dac0c99affe2b4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841888.722208:0:13228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787841888.722215:0:13228:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1787841888.722239:0:13228:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787841888.722251:0:13228:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff92cbff3d2580 x1874687715008640/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787841893 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787841888.722270:0:13228:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff92cbff3d03c0 x1874687715008768/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787841895 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787841888.722279:0:13228:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff92cbff3d12c0 x1874687715009024/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787841900 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787841888.722366:0:13228:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff92cbff3d0780 x1874687715009152/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787841898 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787841888.722397:0:13228:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787841888.722433:0:3297:0:(import.c:65:import_set_state_nolock()) ffff92cbf71ae800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787841888.722438:0:3297:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-5) 00000100:00100000:0.0:1787841888.722443:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff3d0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3297:1874687715009152:0@lo:38:kworker.0 00000100:00080000:0.0:1787841888.722477:0:13228:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787841888.722483:0:13228:0:(import.c:65:import_set_state_nolock()) ffff92cbf71ae800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1787841888.722489:0:13228:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787841888.722493:0:13228:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff92cbff3d2580 x1874687715008640/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787841893 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787841888.722503:0:13228:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff92cbff3d03c0 x1874687715008768/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787841895 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787841888.722532:0:13228:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff92cbff3d12c0 x1874687715009024/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787841900 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787841888.722539:0:13228:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787841888.722543:0:13228:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 16s for inflight to error out 00000100:00100000:3.0:1787841888.722672:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff3d12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1874687715009024:0@lo:400:kworker.0 00000100:00100000:2.0:1787841888.722888:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff3d03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1874687715008768:0@lo:400:kworker.0 00000100:00100000:2.0:1787841888.722898:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff3d2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1874687715008640:0@lo:400:kworker.0 00010000:00010000:0.0:1787841888.727680:0:13228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc169a400/0xe3dac0c99affe2bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe2c2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841888.727728:0:13228:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc169a400/0xe3dac0c99affe2bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe3dac0c99affe2c2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841888.727736:0:13228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc169a400/0xe3dac0c99affe2bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xe3dac0c99affe2c2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841888.727743:0:13228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.101@tcp lock: ffff92cbc169a400/0xe3dac0c99affe2bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xe3dac0c99affe2c2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841888.729607:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787841888.729626:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.101@tcp lock: ffff92cbc169aa00/0xe3dac0c99affe2ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xe3dac0c99affe2b4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841888.729643:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc169aa00 already unused, calling callback (ffffffffc1d9fc20) 10000000:00010000:1.0:1787841888.729648:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.101@tcp lock: ffff92cbc169aa00/0xe3dac0c99affe2ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xe3dac0c99affe2b4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841888.729660:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.101@tcp lock: ffff92cbc169aa00/0xe3dac0c99affe2ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xe3dac0c99affe2b4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787841888.729669:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.101@tcp lock: ffff92cbc169aa00/0xe3dac0c99affe2ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xe3dac0c99affe2b4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787841888.729675:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787841888.729679:0:5826:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1787841888.729683:0:5826:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1787841888.729785:0:5826:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff92cbc2e3e800 00010000:00010000:1.0:1787841888.729790:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.101@tcp lock: ffff92cbc169aa00/0xe3dac0c99affe2ad lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xe3dac0c99affe2b4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841888.729797:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.101@tcp lock: ffff92cbc169aa00/0xe3dac0c99affe2ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xe3dac0c99affe2b4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841888.732432:0:13228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787841888.732498:0:13078:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787841888.732517:0:13078:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.101@tcp lock: ffff92cbc169a400/0xe3dac0c99affe2bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe3dac0c99affe2c2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841888.732537:0:13078:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc169a400 already unused, calling callback (ffffffffc1d9fc20) 10000000:00010000:1.0:1787841888.732542:0:13078:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.101@tcp lock: ffff92cbc169a400/0xe3dac0c99affe2bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe3dac0c99affe2c2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841888.732576:0:13078:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.101@tcp lock: ffff92cbc169a400/0xe3dac0c99affe2bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xe3dac0c99affe2c2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787841888.732584:0:13078:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.101@tcp lock: ffff92cbc169a400/0xe3dac0c99affe2bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xe3dac0c99affe2c2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787841888.732591:0:13078:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787841888.732594:0:13078:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:1.0:1787841888.732609:0:13078:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff92cbc2e3e800 00010000:00010000:1.0:1787841888.732612:0:13078:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.101@tcp lock: ffff92cbc169a400/0xe3dac0c99affe2bb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xe3dac0c99affe2c2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841888.732619:0:13078:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.101@tcp lock: ffff92cbc169a400/0xe3dac0c99affe2bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xe3dac0c99affe2c2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841888.732637:0:13078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841888.732639:0:13078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841888.732641:0:13078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841888.734826:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841888.734834:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841888.734836:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841888.737398:0:13228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc6598a00/0xe3dac0c99affe4e4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99affe4eb expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841888.737419:0:13228:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc6598a00/0xe3dac0c99affe4e4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe3dac0c99affe4eb expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841888.737446:0:13228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc6598a00/0xe3dac0c99affe4e4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xe3dac0c99affe4eb expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841888.737453:0:13228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.101@tcp lock: ffff92cbc6598a00/0xe3dac0c99affe4e4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xe3dac0c99affe4eb expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841888.737482:0:13228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787841888.737490:0:13228:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:2.0:1787841888.737496:0:13228:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1787841888.737544:0:13228:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1787841888.737549:0:13228:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1787841888.737557:0:13228:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787841888.737563:0:13228:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787841888.737568:0:13228:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff92cbf8e23490) has no exports 00000020:00080000:2.0:1787841888.737597:0:13228:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff92cbf8e23490) has no exports 00000020:01000000:2.0:1787841888.739360:0:13228:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff92cbc95d7b40 - data ffff92cbea409948/ffff92cbe7705000 00000020:01000000:2.0:1787841888.739565:0:13228:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff92cbcd8fae40 - data ffff92cbffcc50d8/ffff92cbf04f5000 00010000:00010000:1.0:1787841888.740162:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787841888.740173:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.101@tcp lock: ffff92cbc6598a00/0xe3dac0c99affe4e4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xe3dac0c99affe4eb expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841888.740187:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6598a00 already unused, calling callback (ffffffffc1d9fc20) 10000000:00010000:1.0:1787841888.740193:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.101@tcp lock: ffff92cbc6598a00/0xe3dac0c99affe4e4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xe3dac0c99affe4eb expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841888.740205:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.101@tcp lock: ffff92cbc6598a00/0xe3dac0c99affe4e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xe3dac0c99affe4eb expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787841888.740234:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.101@tcp lock: ffff92cbc6598a00/0xe3dac0c99affe4e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xe3dac0c99affe4eb expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787841888.740241:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787841888.740243:0:5827:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1787841888.740247:0:5827:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1787841888.740262:0:5827:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff92cbc2e3e800 00010000:00010000:1.0:1787841888.740267:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.101@tcp lock: ffff92cbc6598a00/0xe3dac0c99affe4e4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xe3dac0c99affe4eb expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841888.740273:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.101@tcp lock: ffff92cbc6598a00/0xe3dac0c99affe4e4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xe3dac0c99affe4eb expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841888.740300:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841888.740302:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841888.740304:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1787841888.773679:0:13228:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1787841888.801562:0:13228:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe3dac0c99affe1a3 00000020:00000080:0.0:1787841888.801572:0:13228:0:(genops.c:885:class_export_put()) final put ffff92cc01d39800/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1787841888.801593:0:13228:0:(tgt_mount.c:187:server_put_mount()) put mount ffff92cbff856800 from lustre-OST0001, refs=2 00000020:01000004:0.0:1787841888.801598:0:13228:0:(obd_mount.c:710:lustre_put_lsi()) put ffff92cbff856800 2 00000020:01000004:0.0:1787841888.801601:0:13228:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff92cbff856800 from lustre-OST0001 00000020:00000080:0.0:1787841888.801628:0:13228:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787841888.801639:0:13228:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1787841888.801641:0:13228:0:(genops.c:885:class_export_put()) final put ffff92cbff5fa000/lustre-OST0001_UUID 00000020:00000080:0.0:1787841888.801644:0:13228:0:(genops.c:844:class_export_destroy()) destroying export ffff92cbff5fa000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1787841888.801652:0:13228:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000020:00000080:2.0:1787841888.801852:0:12628:0:(genops.c:844:class_export_destroy()) destroying export ffff92cc01d39800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00080000:1.0:1787841888.807781:0:13228:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import f6e7591a-84a0-4774-9d28-b3ed28591dc5->MGS 00010000:00010000:1.0:1787841888.807808:0:13228:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.101@tcp lock: ffff92cbc13a3400/0xe3dac0c99affe0a7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xe3dac0c99affe0ae expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787841888.807825:0:13228:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.101@tcp lock: ffff92cbc13a3400/0xe3dac0c99affe0a7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xe3dac0c99affe0ae expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787841888.807832:0:13228:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1787841888.807835:0:13228:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1787841888.807838:0:13228:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1787841888.807857:0:13228:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff92cbc2e3e800 00010000:00010000:1.0:1787841888.807860:0:13228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.101@tcp lock: ffff92cbc13a3400/0xe3dac0c99affe0a7 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xe3dac0c99affe0ae expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841888.807907:0:13228:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.101@tcp lock: ffff92cbc6599200/0xe3dac0c99affe301 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xe3dac0c99affe308 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787841888.807914:0:13228:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.101@tcp lock: ffff92cbc6599200/0xe3dac0c99affe301 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xe3dac0c99affe308 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787841888.807919:0:13228:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787841888.807921:0:13228:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1787841888.807923:0:13228:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1787841888.807934:0:13228:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff92cbc2e3e800 00010000:00010000:1.0:1787841888.807937:0:13228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.101@tcp lock: ffff92cbc6599200/0xe3dac0c99affe301 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xe3dac0c99affe308 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787841888.807954:0:13228:0:(import.c:65:import_set_state_nolock()) ffff92cbc2e3e800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1787841888.807958:0:13228:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1787841888.807961:0:13228:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1787841888.807962:0:13228:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1787841888.807967:0:13228:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1787841888.807978:0:13228:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff92cbff3d2d00 x1874687715008896/t0(0) o250->MGC192.168.201.101@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787841899 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1787841888.807998:0:13228:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1787841888.808001:0:13228:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 14s for inflight to error out 00000100:00100000:2.0:1787841888.808150:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff3d2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f6e7591a-84a0-4774-9d28-b3ed28591dc5:3297:1874687715008896:0@lo:250:kworker.0 10000000:01000000:1.0:1787841888.808408:0:13228:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1787841888.808419:0:13228:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe3dac0c99affdf96 00000020:00000080:1.0:1787841888.808428:0:13228:0:(genops.c:885:class_export_put()) final put ffff92cbc9410800/f6e7591a-84a0-4774-9d28-b3ed28591dc5 00000020:01000000:1.0:1787841888.808448:0:13228:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.201.101@tcp (flags='') 00000020:00000080:1.0:1787841888.808456:0:13228:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787841888.808466:0:13228:0:(obd_config.c:956:class_cleanup()) MGC192.168.201.101@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787841888.808471:0:13228:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff92cbe9a69a48) has no exports 10000000:01000000:0.0:1787841888.808549:0:5836:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1787841888.808724:0:13228:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.201.101@tcp: client import never connected 00000100:00080000:1.0:1787841888.808735:0:13228:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1787841888.808738:0:13228:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1787841888.808740:0:13228:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1787841888.808741:0:13228:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1787841888.808788:0:13228:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787841888.808796:0:13228:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.201.101@tcp (uuid f6e7591a-84a0-4774-9d28-b3ed28591dc5) 00000020:01000000:1.0:1787841888.808803:0:13228:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1787841888.808806:0:13228:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787841888.808809:0:13228:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787841888.808816:0:13228:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff92cbffa74800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787841888.808821:0:13228:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff92cac218b490) has exports, disconnecting them 00000020:00080000:1.0:1787841888.808826:0:13228:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff92cbffa74800), last request at 1787841646 00000020:00000080:1.0:1787841888.808830:0:13228:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe3dac0c99affe1cd 00000020:00080000:1.0:1787841888.808844:0:13228:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff92cbffa74800): rc 0 00000020:00000080:1.0:1787841888.808848:0:13228:0:(genops.c:885:class_export_put()) final put ffff92cbffa74800/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1787841888.810063:0:12628:0:(genops.c:844:class_export_destroy()) destroying export ffff92cbc9410800/f6e7591a-84a0-4774-9d28-b3ed28591dc5 for MGC192.168.201.101@tcp 00000020:00000080:2.0:1787841888.810085:0:12628:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92cbc2e3e800 for MGC192.168.201.101@tcp 00000020:00000080:2.0:1787841888.810093:0:12628:0:(genops.c:885:class_export_put()) final put ffff92cbc2e38800/f6e7591a-84a0-4774-9d28-b3ed28591dc5 00000020:00000080:2.0:1787841888.810096:0:12628:0:(genops.c:844:class_export_destroy()) destroying export ffff92cbc2e38800/f6e7591a-84a0-4774-9d28-b3ed28591dc5 for MGC192.168.201.101@tcp 00000020:01000000:2.0:1787841888.810101:0:12628:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.201.101@tcp (f6e7591a-84a0-4774-9d28-b3ed28591dc5) 00000020:00000080:2.0:1787841888.810416:0:12628:0:(genops.c:844:class_export_destroy()) destroying export ffff92cbffa74800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1787841888.810897:0:13228:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1787841888.810902:0:13228:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787841888.810906:0:13228:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787841888.810911:0:13228:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787841888.810995:0:12628:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92cbf71ae800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:0.0:1787841888.813326:0:13078:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1787841888.813546:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1787841888.813805:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:0.0:1787841888.813979:0:5822:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff92cbc2e8dc00:5822] 1 exiting: rc = 0 00000100:00100000:0.0:1787841888.814951:0:5821:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff92cbc2e8ca00:5821] 0 exiting: rc = 1 00000100:00100000:2.0:1787841888.815071:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841888.815366:0:7632:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff92cbf6d90400:7632] 3 exiting: rc = 0 00000100:00100000:0.0:1787841888.815760:0:5823:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff92cbc2e8cc00:5823] 0 exiting: rc = 1 00000100:00100000:0.0:1787841888.816904:0:7633:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_004: service thread [ffff92cbe993ca00:7633] 4 exiting: rc = 0 00000100:00100000:3.0:1787841888.819362:0:5825:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff92cbe9998800:5825] 2 exiting: rc = 0 00000100:00100000:3.0:1787841888.819459:0:5824:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff92cbe9999e00:5824] 1 exiting: rc = 0 00000100:00100000:2.0:1787841888.819668:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841888.819679:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841888.819684:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841888.819691:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841888.819765:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841888.819775:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841888.819781:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841888.819787:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841888.819793:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841888.819800:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841888.819806:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841888.819812:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841888.819819:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841888.819826:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841888.819832:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841888.819837:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841888.819844:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841888.819848:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841888.819854:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841888.819858:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841888.819864:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841888.819869:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841888.819874:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841888.819880:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841888.819885:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841888.819890:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841888.819895:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841888.819901:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841888.819907:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841888.819913:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841888.819917:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841888.819923:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841888.819928:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841888.819948:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841888.819954:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841888.819960:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841888.819966:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841888.819972:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841888.819978:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841888.819983:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841888.819989:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841888.819993:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841888.819999:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841888.820004:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841888.820010:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841888.820015:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841888.820020:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841888.820026:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841888.820032:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841888.820037:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841888.820042:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841888.820051:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841888.820056:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841888.820062:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841888.820067:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841888.820072:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841888.820078:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841888.820083:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841888.820088:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841888.820093:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841888.820099:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841888.820105:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841888.820110:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841888.820116:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1787841888.821832:0:13228:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787841888.821845:0:13228:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1787841888.821851:0:13228:0:(genops.c:885:class_export_put()) final put ffff92cbf71aa000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1787841888.821855:0:13228:0:(genops.c:844:class_export_destroy()) destroying export ffff92cbf71aa000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1787841888.821872:0:13228:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:2.0:1787841888.821914:0:13228:0:(obd_mount.c:710:lustre_put_lsi()) put ffff92cbff856800 1 00000020:00000080:2.0:1787841888.821920:0:13228:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe3dac0c99affe172 00000020:00000080:2.0:1787841888.821927:0:13228:0:(genops.c:885:class_export_put()) final put ffff92cbf04da000/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1787841888.821945:0:13228:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1787841888.821949:0:13228:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787841888.821955:0:13228:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787841888.821959:0:13228:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff92cbf4268000) has no exports 00000020:00000080:0.0:1787841888.822623:0:12628:0:(genops.c:844:class_export_destroy()) destroying export ffff92cbf04da000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1787841888.836164:0:13228:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787841888.836303:0:13228:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1787841888.836310:0:13228:0:(genops.c:885:class_export_put()) final put ffff92cbc9412000/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1787841888.836315:0:13228:0:(genops.c:844:class_export_destroy()) destroying export ffff92cbc9412000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1787841888.836325:0:13228:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1787841888.836535:0:13228:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff92cbff853000 00000020:01000000:0.0:1787841888.836558:0:13228:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1787841888.836561:0:13228:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787841888.836565:0:13228:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787841888.836570:0:13228:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff92cbe9988000) has no exports 00000020:00000080:0.0:1787841888.836595:0:13228:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787841888.836602:0:13228:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1787841888.836605:0:13228:0:(genops.c:885:class_export_put()) final put ffff92cbc8b71800/OSS_uuid 00000020:00000080:0.0:1787841888.836607:0:13228:0:(genops.c:844:class_export_destroy()) destroying export ffff92cbc8b71800/OSS_uuid for OSS 00000020:01000000:0.0:1787841888.836611:0:13228:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:0.0:1787841888.836634:0:5834:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1787841888.836860:0:9572:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff92cbc8eb1400:9572] 3 exiting: rc = 0 00000100:00100000:0.0:1787841888.836918:0:6687:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff92cbd1108c00:6687] 1 exiting: rc = 0 00000100:00100000:1.0:1787841888.838616:0:12388:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff92cbd0a22200:12388] 4 exiting: rc = 0 00000100:00100000:0.0:1787841888.838801:0:6688:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff92cc01d94a00:6688] 2 exiting: rc = 0 00000100:00100000:2.0:1787841888.840472:0:6686:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff92cc01d94200:6686] 0 exiting: rc = 1 00000100:00100000:0.0:1787841888.841036:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.841044:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.841052:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.841058:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.841064:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.841069:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.841074:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.841080:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.841085:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.841090:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.841095:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.841100:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.841105:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.841111:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.841116:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.841122:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.841127:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.841132:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.841136:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.841142:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.841253:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.841259:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.841264:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.841269:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.841275:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.841280:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.841292:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.841297:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.841303:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.841308:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.841314:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.841319:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.841324:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.841329:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.841334:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.841341:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.841347:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.841352:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.841357:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.841362:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.841367:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.841372:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.841377:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.841382:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.841387:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.841392:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.841397:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.841402:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.841407:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.841412:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.841418:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.841423:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.841428:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.841433:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.841437:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.841448:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.841458:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.841466:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.841471:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.841477:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.841482:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.841488:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.841492:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.841501:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.843844:0:6690:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff92cc01e70200:6690] 0 exiting: rc = 1 00000100:00100000:3.0:1787841888.844828:0:6691:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff92cc01e70c00:6691] 1 exiting: rc = 0 00000100:00100000:0.0:1787841888.845381:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.845393:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.845399:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.845405:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.845410:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.845415:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.845420:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.845426:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.845430:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.845435:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.845440:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.845446:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.845451:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.845456:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.845461:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.845466:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.845471:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.845475:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.845480:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.845485:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.845489:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.845494:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.845498:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.845503:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.845519:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.845538:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.845543:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.845550:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.845555:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.845560:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.845928:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.845937:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.845942:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.845947:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.845953:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.845958:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.845963:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.845968:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.845974:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.845979:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.845985:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.845989:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.845995:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.846005:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.846013:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.846021:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.846026:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.846031:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.846037:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.846044:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.846050:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.846059:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.846064:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.846069:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.846074:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.846080:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.846084:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.846090:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.846094:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.846099:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.846114:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.846120:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.846124:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.846134:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841888.848644:0:6693:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff92cc01e71000:6693] 1 exiting: rc = 0 00000100:00100000:1.0:1787841888.848868:0:6694:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff92cbc9240400:6694] 2 exiting: rc = 0 00000100:00100000:0.0:1787841888.849726:0:6692:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff92cc01e70000:6692] 0 exiting: rc = 1 00000100:00100000:0.0:1787841888.851490:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.851501:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.851536:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.851544:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.851550:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.851555:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.851560:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.851566:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.851571:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.851577:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.851583:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.851588:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.851594:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.851599:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.851606:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.851612:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.851617:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.851623:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.851629:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.851634:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.851640:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.851645:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.851651:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.851657:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.851661:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.851667:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.851686:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.851761:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.851769:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.851774:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.851793:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.851800:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.851807:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.851813:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.851819:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.851825:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.851832:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.851838:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.851845:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.851853:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.851859:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.851865:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.851872:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.851878:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.851883:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.851889:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.851895:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.851901:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.851907:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.851913:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.851933:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.851941:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.851947:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.851954:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.851961:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.851967:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.851975:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.851981:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.851987:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.851993:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.852000:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.852006:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.852012:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.852020:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787841888.859656:0:6695:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff92cbc9241e00:6695] 0 exiting: rc = 1 00000100:00100000:3.0:1787841888.864471:0:6696:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff92cbc9240800:6696] 1 exiting: rc = 0 00000100:00100000:0.0:1787841888.865002:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.865021:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.865027:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.865033:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.865039:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.865044:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.865050:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.865055:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.865061:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.865067:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.865072:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.865078:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.865084:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.865089:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.865095:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.865101:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.865106:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.865111:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.865116:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.865121:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.865132:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.865138:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.865144:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.865160:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.865262:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.865273:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.865279:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.865355:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.865361:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.865371:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.865377:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.865382:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.865388:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.865393:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.865399:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.865405:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.865418:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.865424:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.865430:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.865437:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.865442:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.865447:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.865454:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.865460:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.865466:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.865494:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.865501:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.865518:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.865523:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.865529:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.865534:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.865540:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.865545:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.865550:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.865555:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.865561:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.865566:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.865571:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.865577:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.865582:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.865588:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.865593:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.865598:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.865610:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.870134:0:6697:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff92cbc9240600:6697] 0 exiting: rc = 1 00000100:00100000:2.0:1787841888.873257:0:6698:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff92cbc9240200:6698] 1 exiting: rc = 0 00000100:00100000:0.0:1787841888.873452:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.873480:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.873500:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.873518:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.873524:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.873530:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.873547:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.873553:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.873560:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.873566:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.873573:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.873580:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.873586:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.873591:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.873612:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.873621:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.873627:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.873634:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.873642:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.873650:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.873657:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.873664:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.873671:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.873678:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.873687:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.873721:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.873745:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.873752:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.873759:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.873765:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.873775:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.873783:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.873793:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.873800:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.873809:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.873815:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.873821:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.873830:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.873853:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.873862:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.873869:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.873883:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.873890:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.873897:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.873903:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.873911:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.873918:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.873924:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.873930:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.873936:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.873957:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.873966:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.873973:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.873980:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.873987:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.873993:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.874000:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.874006:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.874013:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.874020:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.874027:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.874033:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.874039:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787841888.874055:0:13228:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1787841888.892817:0:13228:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1787841909.115839:0:13843:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg101-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1787841920.552063:0:14304:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787841920.552070:0:14304:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1787841920.552202:0:14304:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff92cac3549800 00000020:01000004:1.0:1787841920.552225:0:14304:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1787841920.552235:0:14304:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1787841920.552256:0:14304:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff92cbf8e20000) 00000020:00000080:1.0:1787841920.552275:0:14304:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1787841920.577636:0:14304:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1787841920.584810:0:14304:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:0.0:1787841920.585609:0:14304:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 127: rc = 0 00100000:10000000:0.0:1787841920.586477:0:14304:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 127: rc = 0 00100000:10000000:0.0:1787841920.586790:0:14304:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1787841920.586864:0:14304:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 127: rc = 0 00100000:10000000:0.0:1787841920.587303:0:14304:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 127: rc = 0 00100000:10000000:0.0:1787841920.587395:0:14304:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 127: rc = 0 00100000:10000000:0.0:1787841920.587490:0:14304:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 127: rc = 0 00100000:10000000:0.0:1787841920.587791:0:14304:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 385: rc = 0 00100000:10000000:2.0:1787841920.595044:0:14304:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 589: rc = 0 00100000:10000000:2.0:1787841920.595153:0:14304:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 589: rc = 0 00100000:10000000:2.0:1787841920.595583:0:14304:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 405: rc = 0 00100000:10000000:3.0:1787841920.598655:0:14304:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 405: rc = 0 00100000:10000000:3.0:1787841920.600309:0:14304:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 405: rc = 0 00100000:10000000:3.0:1787841920.600648:0:14304:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 405: rc = 0 00100000:10000000:3.0:1787841920.602259:0:14304:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 405: rc = 0 00100000:10000000:3.0:1787841920.602602:0:14304:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 405: rc = 0 00100000:10000000:3.0:1787841920.602949:0:14304:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 405: rc = 0 00100000:10000000:3.0:1787841920.603177:0:14304:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 405: rc = 0 00100000:10000000:3.0:1787841920.603403:0:14304:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 405: rc = 0 00100000:10000000:3.0:1787841920.603670:0:14304:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 405: rc = 0 00100000:10000000:3.0:1787841920.604077:0:14304:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 405: rc = 0 00100000:10000000:3.0:1787841920.604314:0:14304:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 405: rc = 0 00100000:10000000:3.0:1787841920.604885:0:14304:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 660: rc = 0 00100000:10000000:3.0:1787841920.605153:0:14304:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 660: rc = 0 00100000:10000000:3.0:1787841920.605393:0:14304:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 660: rc = 0 00100000:10000000:3.0:1787841920.605764:0:14304:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 660: rc = 0 00100000:10000000:3.0:1787841920.606012:0:14304:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 660: rc = 0 00100000:10000000:3.0:1787841920.606252:0:14304:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 660: rc = 0 00100000:10000000:3.0:1787841920.606482:0:14304:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 660: rc = 0 00100000:10000000:3.0:1787841920.606833:0:14304:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 660: rc = 0 00100000:10000000:3.0:1787841920.607081:0:14304:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 660: rc = 0 00100000:10000000:3.0:1787841920.607342:0:14304:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 660: rc = 0 00100000:10000000:3.0:1787841920.607582:0:14304:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 660: rc = 0 00100000:10000000:3.0:1787841920.607963:0:14304:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 660: rc = 0 00100000:10000000:3.0:1787841920.608200:0:14304:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 660: rc = 0 00100000:10000000:3.0:1787841920.608444:0:14304:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 660: rc = 0 00100000:10000000:3.0:1787841920.608668:0:14304:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 660: rc = 0 00100000:10000000:3.0:1787841920.609013:0:14304:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 660: rc = 0 00100000:10000000:3.0:1787841920.609249:0:14304:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 660: rc = 0 00100000:10000000:3.0:1787841920.609497:0:14304:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 660: rc = 0 00100000:10000000:3.0:1787841920.609764:0:14304:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 660: rc = 0 00100000:10000000:3.0:1787841920.610135:0:14304:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 660: rc = 0 00100000:10000000:3.0:1787841920.610366:0:14304:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 660: rc = 0 00100000:10000000:3.0:1787841920.610626:0:14304:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 660: rc = 0 00100000:10000000:3.0:1787841920.611004:0:14304:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 660: rc = 0 00100000:10000000:3.0:1787841920.611246:0:14304:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 660: rc = 0 00100000:10000000:3.0:1787841920.611475:0:14304:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 660: rc = 0 00100000:10000000:3.0:1787841920.611668:0:14304:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 660: rc = 0 00100000:10000000:3.0:1787841920.612041:0:14304:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 660: rc = 0 00100000:10000000:3.0:1787841920.612233:0:14304:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 660: rc = 0 00100000:10000000:3.0:1787841920.612421:0:14304:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 660: rc = 0 00100000:10000000:3.0:1787841920.612617:0:14304:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 660: rc = 0 00100000:10000000:3.0:1787841920.612869:0:14304:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 660: rc = 0 00100000:10000000:3.0:1787841920.613128:0:14304:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 660: rc = 0 00100000:10000000:3.0:1787841920.613410:0:14304:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 774: rc = 0 00100000:10000000:3.0:1787841920.614085:0:14304:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:3.0:1787841920.614254:0:14304:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 772: rc = 0 00100000:10000000:3.0:1787841920.614441:0:14304:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:3.0:1787841920.614537:0:14304:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 772: rc = 0 00100000:10000000:3.0:1787841920.614670:0:14304:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:3.0:1787841920.614964:0:14304:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 772: rc = 0 00100000:10000000:3.0:1787841920.615422:0:14304:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:3.0:1787841920.615465:0:14304:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 590: rc = 0 00100000:10000000:3.0:1787841920.615659:0:14304:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:3.0:1787841920.616132:0:14304:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 590: rc = 0 00100000:10000000:3.0:1787841920.616628:0:14304:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:3.0:1787841920.616670:0:14304:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 590: rc = 0 00000020:00000080:3.0:1787841920.617026:0:14304:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1787841920.617032:0:14304:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787841920.617039:0:14304:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe3dac0c99afff297 00000020:01000004:3.0:1787841920.617045:0:14304:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1787841920.617048:0:14304:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1787841920.617052:0:14304:0:(tgt_mount.c:101:server_register_mount()) register mount ffff92cac3549800 from MGS 00000020:01000004:3.0:1787841920.617054:0:14304:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1787841920.617062:0:14304:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff92cbe9a6ced8) 00000020:00000080:3.0:1787841920.617068:0:14304:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1787841920.617118:0:14304:0:(tgt_mount.c:153:server_get_mount()) get mount ffff92cac3549800 from MGS, refs=2 00080000:01000000:3.0:1787841920.617123:0:14304:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787841920.617127:0:14304:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe3dac0c99afff2a5 00000100:00100000:3.0:1787841920.617253:0:14304:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1787841920.617404:0:14304:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1787841920.617408:0:14304:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1787841920.617933:0:14304:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1787841920.617938:0:14304:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1787841920.618557:0:14304:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787841920.618663:0:14304:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1787841920.618667:0:14304:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1787841920.619272:0:14304:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1787841920.619276:0:14304:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1787841920.619592:0:14304:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1787841920.619596:0:14304:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1787841920.622296:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841920.622301:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841920.622310:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841920.622655:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841920.622658:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841920.622660:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841920.623244:0:14304:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1787841920.625863:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1787841920.630552:0:14304:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1787841920.630567:0:14304:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787841920.630569:0:14304:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1787841920.632044:0:14313:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1787841920.632174:0:14304:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1787841920.632268:0:14304:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787841920.635923:0:14304:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1787841920.636995:0:14304:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787841920.637461:0:14304:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1787841920.637474:0:14304:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1787841920.638330:0:14304:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1787841920.638338:0:14304:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1787841920.638969:0:14304:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1787841920.638976:0:14304:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:1.0:1787841920.642014:0:14318:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:3.0:1787841920.642133:0:14304:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1787841920.642152:0:14304:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.101@tcp' 00000020:01000004:3.0:1787841920.642153:0:14304:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1787841920.642183:0:14304:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.101@tcp (typ=mgc) 00000020:00000080:3.0:1787841920.642195:0:14304:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.101@tcp (ffff92cbe9a68000) 00000020:00000080:3.0:1787841920.642212:0:14304:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1787841920.642267:0:14304:0:(ldlm_lib.c:102:import_set_conn()) imp ffff92cac23e9000@MGC192.168.201.101@tcp: add connection 192.168.201.101@tcp at head 00010000:00010000:3.0:1787841920.642392:0:14304:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.101@tcp-0 is initialized 00000040:01000000:3.0:1787841920.642397:0:14304:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.101@tcp ctxt 1 is initialized 10000000:01000000:3.0:1787841920.643009:0:14319:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1787841920.643043:0:14304:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.101@tcp (uuid a5c21f71-9ee1-4aef-b035-d0eddff43cd3) 00000020:00000080:1.0:1787841920.643060:0:14304:0:(genops.c:1385:class_connect()) connect: client a5c21f71-9ee1-4aef-b035-d0eddff43cd3, cookie 0xe3dac0c99afff2b3 00000100:00080000:1.0:1787841920.643070:0:14304:0:(import.c:510:import_select_connection()) MGC192.168.201.101@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787841920.643077:0:14304:0:(import.c:624:import_select_connection()) MGC192.168.201.101@tcp: import ffff92cac23e9000 using connection 192.168.201.101@tcp/0@lo 00000100:00100000:1.0:1787841920.643112:0:14304:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92cbf6e2da40 x1874687715009280/t0(0) o250->MGC192.168.201.101@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787841920.643148:0:14304:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import a5c21f71-9ee1-4aef-b035-d0eddff43cd3->MGS 00000020:01000004:1.0:1787841920.643170:0:14304:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1787841920.643174:0:14304:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1787841920.643184:0:14304:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff92cbf8e21a48) 00000020:00000080:1.0:1787841920.643192:0:14304:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1787841920.643429:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e2da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:3297:1874687715009280:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1787841920.643496:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841920.649003:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715009280 00000100:00100000:3.0:1787841920.649019:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715009280 00000100:00100000:3.0:1787841920.649066:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787841920.649078:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe76e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3297:x1874687715009280:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1787841920.649108:0:14315:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from a5c21f71-9ee1-4aef-b035-d0eddff43cd3@0@lo t0 exp 0000000000000000 cur 460 last 0 00000020:00000080:3.0:1787841920.649141:0:14315:0:(genops.c:1385:class_connect()) connect: client a5c21f71-9ee1-4aef-b035-d0eddff43cd3, cookie 0xe3dac0c99afff2c1 00000100:00080000:3.0:1787841920.649274:0:14315:0:(import.c:65:import_set_state_nolock()) ffff92cac23ea000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787841920.649430:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe76e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+5:3297:x1874687715009280:12345-0@lo:250:mount.lustre.0 Request processed in 353us (5933us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841920.649439:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787841920.649587:0:3297:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.201.101@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1787841920.649598:0:3297:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.101@tcp: connect to target with instance 0 00000100:00080000:2.0:1787841920.649608:0:3297:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.101@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1787841920.649614:0:3297:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1787841920.649618:0:3297:0:(import.c:65:import_set_state_nolock()) ffff92cac23e9000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1787841920.649620:0:3297:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1787841920.649629:0:3297:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1787841920.649634:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e2da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:3297:1874687715009280:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1787841920.652743:0:14304:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787841920.652970:0:14304:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1787841920.652978:0:14304:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1787841920.653924:0:14304:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1787841920.653932:0:14304:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1787841920.655235:0:14304:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1787841920.655244:0:14304:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1787841920.656608:0:14304:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787841920.657073:0:14304:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1787841920.657082:0:14304:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1787841920.660440:0:14304:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1787841920.660450:0:14304:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1787841920.714460:0:14304:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787841920.714689:0:14304:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1787841920.714715:0:14304:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1787841920.716191:0:14304:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1787841920.716203:0:14304:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1787841920.716771:0:14304:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787841920.716944:0:14304:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787841920.716960:0:14304:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1787841920.718426:0:14304:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787841920.718436:0:14304:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1787841920.719399:0:14304:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787841920.719568:0:14304:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787841920.719574:0:14304:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1787841920.720344:0:14304:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787841920.720351:0:14304:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1787841920.721232:0:14304:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787841920.721470:0:14304:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787841920.721475:0:14304:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1787841920.722194:0:14304:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787841920.722201:0:14304:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1787841920.757191:0:14304:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787841920.757419:0:14304:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787841920.757426:0:14304:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1787841920.767235:0:14304:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787841920.767253:0:14304:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1787841920.770737:0:14304:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1787841920.770907:0:14304:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1787841920.792345:0:14304:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1787841920.792384:0:14304:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1787841920.792390:0:14304:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.101@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1787841920.792521:0:14304:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.101@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787841920.792562:0:14304:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.101@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1787841920.792566:0:14304:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787841920.792568:0:14304:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787841920.792569:0:14304:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787841920.792571:0:14304:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787841920.792572:0:14304:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787841920.792574:0:14304:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787841920.792575:0:14304:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787841920.792576:0:14304:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787841920.792578:0:14304:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787841920.792579:0:14304:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787841920.792582:0:14304:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1787841920.792585:0:14304:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787841920.792586:0:14304:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787841920.792587:0:14304:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787841920.792588:0:14304:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787841920.792589:0:14304:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787841920.792593:0:14304:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787841920.792594:0:14304:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787841920.792595:0:14304:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787841920.792596:0:14304:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787841920.792597:0:14304:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787841920.792632:0:14304:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787841920.792649:0:14304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac26de940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:14304:1874687715009408:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787841920.793226:0:14304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841920.793301:0:14304:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbd0be1180 going to sleep for 11 seconds 00000100:00100000:2.0:1787841920.793486:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715009408 00000100:00100000:2.0:1787841920.793494:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715009408 00000100:00100000:2.0:1787841920.793554:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787841920.793563:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe76e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+5:14304:x1874687715009408:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787841920.793600:0:14317:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787841920.793604:0:14317:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1787841920.793606:0:14317:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1787841920.794148:0:14338:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1787841920.794471:0:14317:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:3.0:1787841920.795733:0:14339:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1787841920.795747:0:14339:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1787841920.795751:0:14339:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1787841920.795786:0:14339:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:0.0:1787841920.796095:0:14317:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787841920.796105:0:14317:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1787841920.812364:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe76e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+5:14304:x1874687715009408:12345-0@lo:253:mount.lustre.0 Request processed in 18794us (19131us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841920.812379:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787841920.813040:0:14304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac26de940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:14304:1874687715009408:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787841920.813072:0:14304:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787841920.813075:0:14304:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787841920.813077:0:14304:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787841920.813078:0:14304:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787841920.813080:0:14304:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787841920.813081:0:14304:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787841920.813082:0:14304:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787841920.813084:0:14304:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787841920.813086:0:14304:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787841920.813087:0:14304:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787841920.813089:0:14304:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787841920.813189:0:14304:0:(tgt_mount.c:101:server_register_mount()) register mount ffff92cac3549800 from lustre-MDT0000 10000000:01000000:3.0:1787841920.813216:0:14304:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1787841920.813219:0:14304:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787841920.813223:0:14304:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff92cbe9a68000 10000000:01000000:3.0:1787841920.813228:0:14304:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787841920.813236:0:14304:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff92cbe9a68000 from 1 10000000:01000000:3.0:1787841920.813239:0:14304:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787841920.813281:0:14304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc149d400/0xe3dac0c99afff2c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841920.813292:0:14304:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff92cbc149d400/0xe3dac0c99afff2c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841920.813313:0:14304:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff92cbc149d400/0xe3dac0c99afff2c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841920.813334:0:14304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac3092580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:14304:1874687715009536:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787841920.813379:0:14304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841920.813420:0:14304:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbf0559840 going to sleep for 11 seconds 00000100:00100000:0.0:1787841920.813425:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715009536 00000100:00100000:0.0:1787841920.813430:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715009536 00000100:00100000:0.0:1787841920.813472:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787841920.813482:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe76e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+5:14304:x1874687715009536:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787841920.813495:0:14316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841920.813510:0:14316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92cbffa3b600/0xe3dac0c99afff2cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe3dac0c99afff2c8 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841920.813531:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92cbffa3b600/0xe3dac0c99afff2cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe3dac0c99afff2c8 expref: 6 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841920.813539:0:14316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92cbffa3b600/0xe3dac0c99afff2cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe3dac0c99afff2c8 expref: 6 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841920.813546:0:14316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbffa3b600, rc 0) 00000100:00100000:0.0:1787841920.813577:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe76e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+6:14304:x1874687715009536:12345-0@lo:101:mount.lustre.0 Request processed in 98us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841920.813590:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787841920.813596:0:14304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac3092580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:14304:1874687715009536:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787841920.813607:0:14304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff92cbc149d400/0xe3dac0c99afff2c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99afff2cf expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841920.813616:0:14304:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff92cbc149d400/0xe3dac0c99afff2c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe3dac0c99afff2cf expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841920.813658:0:14304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac3092580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:14304:1874687715009664:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787841920.813681:0:14304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841920.813746:0:14304:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbf0559840 going to sleep for 11 seconds 00000100:00100000:0.0:1787841920.815212:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715009664 00000100:00100000:0.0:1787841920.815224:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715009664 00000100:00100000:0.0:1787841920.815273:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787841920.815282:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe76e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+6:14304:x1874687715009664:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787841920.815639:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe76e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+6:14304:x1874687715009664:12345-0@lo:501:mount.lustre.0 Request processed in 342us (1940us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787841920.815657:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787841920.815908:0:14304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac3092580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:14304:1874687715009664:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787841920.815940:0:14304:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787841920.815991:0:14304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc149d400/0xe3dac0c99afff2c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99afff2cf expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841920.816002:0:14304:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff92cbc149d400/0xe3dac0c99afff2c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99afff2cf expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787841920.816009:0:14304:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff92cac3549800 10000000:01000000:1.0:1787841920.816016:0:14304:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787841920.816020:0:14304:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff92cac3549800 10000000:01000000:1.0:1787841920.816023:0:14304:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1787841920.816026:0:14304:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff92cac3549800 from 1 10000000:01000000:1.0:1787841920.816029:0:14304:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1787841920.816055:0:14304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cc00d9d200/0xe3dac0c99afff2d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841920.816061:0:14304:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff92cc00d9d200/0xe3dac0c99afff2d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841920.816069:0:14304:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff92cc00d9d200/0xe3dac0c99afff2d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841920.816094:0:14304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e2de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:14304:1874687715009792:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787841920.816143:0:14304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841920.816177:0:14304:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cac2ed4540 going to sleep for 11 seconds 00000100:00100000:0.0:1787841920.816239:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715009792 00000100:00100000:0.0:1787841920.816244:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715009792 00000100:00100000:0.0:1787841920.816281:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787841920.816289:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe76e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+6:14304:x1874687715009792:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787841920.816299:0:14316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841920.816312:0:14316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92cbffa3a200/0xe3dac0c99afff2dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe3dac0c99afff2d6 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841920.816350:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92cbffa3a200/0xe3dac0c99afff2dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe3dac0c99afff2d6 expref: 7 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841920.816360:0:14316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92cbffa3a200/0xe3dac0c99afff2dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe3dac0c99afff2d6 expref: 7 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841920.816367:0:14316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbffa3a200, rc 0) 00000100:00100000:0.0:1787841920.816423:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe76e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+7:14304:x1874687715009792:12345-0@lo:101:mount.lustre.0 Request processed in 121us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841920.816429:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787841920.816542:0:14304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e2de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:14304:1874687715009792:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787841920.816564:0:14304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff92cc00d9d200/0xe3dac0c99afff2d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99afff2dd expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841920.816571:0:14304:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff92cc00d9d200/0xe3dac0c99afff2d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe3dac0c99afff2dd expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787841920.816582:0:14304:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1787841920.816661:0:14304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cc00d9d200/0xe3dac0c99afff2d6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99afff2dd expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841920.816667:0:14304:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff92cc00d9d200/0xe3dac0c99afff2d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99afff2dd expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787841920.816672:0:14304:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787841920.816675:0:14304:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787841920.816679:0:14304:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff92cac3549800 10000000:01000000:2.0:1787841920.816681:0:14304:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1787841920.816684:0:14304:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1787841920.816686:0:14304:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787841920.816845:0:14304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc6104c00/0xe3dac0c99afff2e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841920.816852:0:14304:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff92cbc6104c00/0xe3dac0c99afff2e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841920.816859:0:14304:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff92cbc6104c00/0xe3dac0c99afff2e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841920.816871:0:14304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff3d21c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:14304:1874687715009920:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787841920.816907:0:14304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841920.816923:0:14304:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cac2020480 going to sleep for 11 seconds 00000100:00100000:0.0:1787841920.816983:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715009920 00000100:00100000:0.0:1787841920.816992:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715009920 00000100:00100000:0.0:1787841920.817076:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787841920.817083:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe76e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+7:14304:x1874687715009920:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787841920.817090:0:14317:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841920.817099:0:14317:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92cbffa3b000/0xe3dac0c99afff2eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe3dac0c99afff2e4 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841920.817127:0:14317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92cbffa3b000/0xe3dac0c99afff2eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe3dac0c99afff2e4 expref: 8 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841920.817134:0:14317:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92cbffa3b000/0xe3dac0c99afff2eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe3dac0c99afff2e4 expref: 8 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841920.817140:0:14317:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbffa3b000, rc 0) 00000100:00100000:0.0:1787841920.817175:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe76e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+8:14304:x1874687715009920:12345-0@lo:101:mount.lustre.0 Request processed in 92us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841920.817181:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787841920.817237:0:14304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff3d21c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:14304:1874687715009920:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787841920.817247:0:14304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff92cbc6104c00/0xe3dac0c99afff2e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99afff2eb expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841920.817255:0:14304:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff92cbc6104c00/0xe3dac0c99afff2e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe3dac0c99afff2eb expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841920.817299:0:14304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff3d21c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:14304:1874687715010048:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787841920.817324:0:14304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841920.817432:0:14304:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cac2020480 going to sleep for 11 seconds 00000100:00100000:1.0:1787841920.817479:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715010048 00000100:00100000:1.0:1787841920.817483:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715010048 00000100:00100000:1.0:1787841920.817501:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787841920.817507:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe76e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+8:14304:x1874687715010048:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787841920.820263:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe76e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+9:14304:x1874687715010048:12345-0@lo:501:mount.lustre.0 Request processed in 2747us (2929us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841920.820276:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787841920.820831:0:14304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff3d21c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:14304:1874687715010048:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787841920.820889:0:14304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac26dc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:14304:1874687715010176:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787841920.820944:0:14304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841920.820993:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715010176 00000100:00100000:0.0:1787841920.820996:0:14304:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc82edc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787841920.821000:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715010176 00000100:00100000:3.0:1787841920.821046:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787841920.821055:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe76e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+9:14304:x1874687715010176:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787841920.821365:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe76e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+9:14304:x1874687715010176:12345-0@lo:503:mount.lustre.0 Request processed in 311us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841920.821372:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787841920.821478:0:14304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac26dc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:14304:1874687715010176:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787841920.822082:0:14340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac30903c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:14340:1874687715010304:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787841920.822119:0:14340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841920.822153:0:14340:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbf0559d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787841920.822207:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715010304 00000100:00100000:1.0:1787841920.822211:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715010304 00000100:00100000:1.0:1787841920.822247:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787841920.822253:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe76e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+9:14340:x1874687715010304:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787841920.822475:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe76e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+9:14340:x1874687715010304:12345-0@lo:502:llog_process_th.0 Request processed in 221us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841920.822481:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787841920.822598:0:14340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac30903c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:14340:1874687715010304:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787841920.822619:0:14340:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787841920.822629:0:14340:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787841920.822631:0:14340:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787841920.822636:0:14340:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1787841920.822642:0:14340:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787841920.822655:0:14340:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff92cbffa44ed8) 00000020:00000080:0.0:1787841920.822672:0:14340:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1787841920.822677:0:14340:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1787841920.822791:0:14340:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:0.0:1787841920.822802:0:14340:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe3dac0c99afff2f9 00000020:00000080:0.0:1787841920.823009:0:14340:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1787841920.823013:0:14340:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787841920.823016:0:14340:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787841920.823017:0:14340:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787841920.823019:0:14340:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787841920.823022:0:14340:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787841920.823023:0:14340:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1787841920.823026:0:14340:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787841920.823032:0:14340:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff92cbffa40000) 00000020:00000080:0.0:1787841920.823040:0:14340:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1787841920.823043:0:14340:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1787841920.823044:0:14340:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1787841920.823047:0:14340:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1787841920.823051:0:14340:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787841920.823082:0:14340:0:(tgt_mount.c:153:server_get_mount()) get mount ffff92cac3549800 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1787841920.823092:0:14340:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff92cbffa41a48) 00000020:00000080:0.0:1787841920.823098:0:14340:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1787841920.823142:0:14340:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1787841920.823146:0:14340:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe3dac0c99afff30e 00000020:00000080:0.0:1787841920.823228:0:14340:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1787841920.823243:0:14340:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1787841920.823247:0:14340:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xe3dac0c99afff315 00080000:01000000:0.0:1787841920.823250:0:14340:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:0.0:1787841920.823253:0:14340:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe3dac0c99afff31c 00010000:00010000:1.0:1787841921.033565:0:14340:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:1.0:1787841921.034110:0:14340:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:1.0:1787841921.034276:0:14340:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1787841921.034974:0:14340:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff92cbf8e23490) 00000020:00000080:1.0:1787841921.034993:0:14340:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1787841921.035073:0:14340:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:1.0:1787841921.035080:0:14340:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe3dac0c99afff32a 00000020:00000080:0.0:1787841921.038984:0:14340:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1787841921.047443:0:14340:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xe3dac0c99afff331 00000020:00000080:3.0:1787841921.048307:0:14340:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1787841921.048319:0:14340:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787841921.048325:0:14340:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787841921.048327:0:14340:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1787841921.048332:0:14340:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787841921.048335:0:14340:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:3.0:1787841921.048336:0:14340:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787841921.048337:0:14340:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787841921.048338:0:14340:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787841921.048341:0:14340:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787841921.048342:0:14340:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787841921.048344:0:14340:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787841921.048349:0:14340:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787841921.048350:0:14340:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1787841921.048354:0:14340:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1787841921.048399:0:14340:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1787841921.048414:0:14340:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787841921.048417:0:14340:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787841921.048418:0:14340:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1787841921.048421:0:14340:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787841921.048424:0:14340:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1787841921.048429:0:14340:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787841921.048430:0:14340:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1787841921.048433:0:14340:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787841921.048438:0:14340:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.101@tcp to nid 0x20000c0a8c965 (192.168.201.101@tcp) 00000020:01000000:3.0:1787841921.048464:0:14340:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787841921.048467:0:14340:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787841921.048482:0:14340:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff92cbe9a69a48) 00000020:00000080:3.0:1787841921.048496:0:14340:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1787841921.048500:0:14340:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787841921.048551:0:14340:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1787841921.048556:0:14340:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:3.0:1787841921.048570:0:14340:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe3dac0c99afff33f 00010000:00080000:3.0:1787841921.048602:0:14340:0:(ldlm_lib.c:102:import_set_conn()) imp ffff92cbc7985000@lustre-OST0000-osc-MDT0000: add connection 192.168.201.101@tcp at head 00010000:00010000:3.0:1787841921.049062:0:14340:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:3.0:1787841921.049507:0:14340:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1787841921.049552:0:14340:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1787841921.051200:0:14340:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787841921.051497:0:14340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1787841921.051591:0:14340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1787841921.052178:0:14343:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787841921.052184:0:14343:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1787841921.052996:0:14340:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787841921.053009:0:14340:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787841921.053041:0:14340:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1787841921.053060:0:14340:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe3dac0c99afff346 00000100:00080000:1.0:1787841921.053071:0:14340:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787841921.053078:0:14340:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff92cbc7985000 using connection 192.168.201.101@tcp/0@lo 00000100:00100000:1.0:1787841921.053126:0:14340:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92cbf6e2d2c0 x1874687715010432/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787841921.053159:0:14340:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1787841921.053206:0:14340:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787841921.053211:0:14340:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787841921.053212:0:14340:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1787841921.053215:0:14340:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787841921.053218:0:14340:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1787841921.053219:0:14340:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787841921.053220:0:14340:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787841921.053221:0:14340:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787841921.053224:0:14340:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787841921.053225:0:14340:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787841921.053237:0:14340:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787841921.053251:0:14340:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1787841921.053254:0:14340:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787841921.053255:0:14340:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1787841921.053258:0:14340:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787841921.053261:0:14340:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.101@tcp to nid 0x20000c0a8c965 (192.168.201.101@tcp) 00000020:01000000:1.0:1787841921.053297:0:14340:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787841921.053299:0:14340:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787841921.053310:0:14340:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff92cbf8e24ed8) 00000020:00000080:1.0:1787841921.053320:0:14340:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1787841921.053323:0:14340:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787841921.053375:0:14340:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1787841921.053381:0:14340:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:1.0:1787841921.053387:0:14340:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe3dac0c99afff354 00010000:00080000:1.0:1787841921.053418:0:14340:0:(ldlm_lib.c:102:import_set_conn()) imp ffff92cbff853000@lustre-OST0001-osc-MDT0000: add connection 192.168.201.101@tcp at head 00010000:00010000:1.0:1787841921.053596:0:14340:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1787841921.053783:0:14340:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787841921.053803:0:14340:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1787841921.054393:0:14340:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787841921.054459:0:14340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1787841921.054531:0:14340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00100000:3.0:1787841921.054995:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e2d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1874687715010432:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1787841921.055065:0:3297:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874687715010432 offset 0 length 520: 4 00000100:00100000:2.0:1787841921.055533:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787841921.055543:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac3092d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:3298:1874687715010560:0@lo:400:kworker.0 00000100:00100000:2.0:1787841921.055587:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841921.056509:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715010560 00000100:00100000:3.0:1787841921.056522:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715010560 00000100:00100000:3.0:1787841921.056574:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787841921.056583:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe76e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+9:3298:x1874687715010560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787841921.056671:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe76e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+9:3298:x1874687715010560:12345-0@lo:400:kworker.0 Request processed in 74us (1068us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841921.056678:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787841921.060521:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac3092d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:3298:1874687715010560:0@lo:400:kworker.0 00000040:00080000:3.0:1787841921.064973:0:14345:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787841921.064982:0:14345:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1787841921.069658:0:14340:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787841921.069672:0:14340:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787841921.069748:0:14340:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1787841921.069767:0:14340:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe3dac0c99afff35b 00000100:00080000:0.0:1787841921.069778:0:14340:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787841921.069784:0:14340:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff92cbff853000 using connection 192.168.201.101@tcp/0@lo 00000100:00100000:0.0:1787841921.069831:0:14340:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92cac26dc000 x1874687715010688/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787841921.069860:0:14340:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1787841921.069931:0:14340:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787841921.069935:0:14340:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787841921.069937:0:14340:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1787841921.069940:0:14340:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787841921.069954:0:14340:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787841921.069956:0:14340:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787841921.069959:0:14340:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787841921.069960:0:14340:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787841921.069962:0:14340:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787841921.069964:0:14340:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787841921.069965:0:14340:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787841921.069967:0:14340:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787841921.069969:0:14340:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787841921.069970:0:14340:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787841921.069973:0:14340:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1787841921.070012:0:14340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac26df0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:14340:1874687715010816:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787841921.070086:0:14340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841921.070124:0:14340:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc82edb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787841921.070147:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715010816 00000100:00100000:0.0:1787841921.070152:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715010816 00000100:00100000:0.0:1787841921.070186:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787841921.070194:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe76e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+9:14340:x1874687715010816:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787841921.070538:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac26dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1874687715010688:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1787841921.070571:0:3297:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874687715010688 offset 0 length 520: 4 00000100:00100000:1.0:1787841921.071931:0:14340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac26df0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:14340:1874687715010816:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787841921.071979:0:14340:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787841921.071986:0:14340:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787841921.071988:0:14340:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787841921.071992:0:14340:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000100:00100000:0.0:1787841921.072372:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe76e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+9:14340:x1874687715010816:12345-0@lo:502:llog_process_th.0 Request processed in 1499us (1606us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841921.072391:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000020:01000000:0.0:1787841921.072444:0:14304:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:0.0:1787841921.072468:0:14304:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787841921.072491:0:14304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc6104c00/0xe3dac0c99afff2e4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99afff2eb expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841921.072503:0:14304:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff92cbc6104c00/0xe3dac0c99afff2e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99afff2eb expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787841921.072510:0:14304:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff92cac3549800 from 1 10000000:01000000:0.0:1787841921.072513:0:14304:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787841921.072544:0:14304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbffa3a600/0xe3dac0c99afff362 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841921.072551:0:14304:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff92cbffa3a600/0xe3dac0c99afff362 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841921.072562:0:14304:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff92cbffa3a600/0xe3dac0c99afff362 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841921.072580:0:14304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac26dfc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:14304:1874687715010944:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787841921.072619:0:14304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841921.072642:0:14304:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc82ed240 going to sleep for 11 seconds 00000100:00100000:1.0:1787841921.073305:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715010944 00000100:00100000:1.0:1787841921.073312:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715010944 00000100:00100000:1.0:1787841921.073343:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787841921.073353:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe76e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+9:14304:x1874687715010944:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787841921.073364:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841921.073379:0:14315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92cc00d9d800/0xe3dac0c99afff369 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe3dac0c99afff362 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841921.073401:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92cc00d9d800/0xe3dac0c99afff369 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe3dac0c99afff362 expref: 10 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841921.073410:0:14315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92cc00d9d800/0xe3dac0c99afff369 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe3dac0c99afff362 expref: 10 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841921.073419:0:14315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cc00d9d800, rc 0) 00000100:00100000:1.0:1787841921.073459:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe76e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+10:14304:x1874687715010944:12345-0@lo:101:mount.lustre.0 Request processed in 108us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841921.073465:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787841921.074692:0:14304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac26dfc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:14304:1874687715010944:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787841921.074808:0:14304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff92cbffa3a600/0xe3dac0c99afff362 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99afff369 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841921.074818:0:14304:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff92cbffa3a600/0xe3dac0c99afff362 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe3dac0c99afff369 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841921.075996:0:14304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac26dfc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:14304:1874687715011072:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1787841921.076066:0:14304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841921.076100:0:14304:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc82ed240 going to sleep for 11 seconds 00000100:00100000:3.0:1787841921.076235:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715011072 00000100:00100000:3.0:1787841921.076251:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715011072 00000100:00100000:3.0:1787841921.076307:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787841921.076317:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe76e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+10:14304:x1874687715011072:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1787841921.076348:0:14316:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1787841921.076356:0:14316:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1787841921.076436:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe76e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+10:14304:x1874687715011072:12345-0@lo:256:mount.lustre.0 Request processed in 120us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841921.076444:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787841921.078074:0:14304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac26dfc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:14304:1874687715011072:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1787841921.082929:0:14304:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787841921.082966:0:14304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbffa3a600/0xe3dac0c99afff362 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99afff369 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841921.082978:0:14304:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff92cbffa3a600/0xe3dac0c99afff362 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99afff369 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787841921.083866:0:14304:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92cac3549800 from 1 10000000:01000000:1.0:1787841921.083871:0:14304:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787841921.083911:0:14304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cc00d9de00/0xe3dac0c99afff370 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841921.083935:0:14304:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff92cc00d9de00/0xe3dac0c99afff370 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841921.083959:0:14304:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff92cc00d9de00/0xe3dac0c99afff370 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841921.083983:0:14304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e2de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:14304:1874687715011200:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787841921.084047:0:14304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841921.084083:0:14304:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbda4d1000 going to sleep for 11 seconds 00000100:00100000:3.0:1787841921.085991:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715011200 00000100:00100000:3.0:1787841921.086003:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715011200 00000100:00100000:3.0:1787841921.086075:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787841921.086085:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6ff5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+10:14304:x1874687715011200:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787841921.086099:0:14317:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841921.086119:0:14317:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92cbc149d600/0xe3dac0c99afff377 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe3dac0c99afff370 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841921.086142:0:14317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92cbc149d600/0xe3dac0c99afff377 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe3dac0c99afff370 expref: 11 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841921.086152:0:14317:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92cbc149d600/0xe3dac0c99afff377 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe3dac0c99afff370 expref: 11 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841921.086161:0:14317:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc149d600, rc 0) 00000100:00100000:3.0:1787841921.086253:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6ff5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+11:14304:x1874687715011200:12345-0@lo:101:mount.lustre.0 Request processed in 169us (2205us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841921.086260:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787841921.086472:0:14304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e2de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:14304:1874687715011200:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787841921.086490:0:14304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff92cc00d9de00/0xe3dac0c99afff370 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99afff377 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841921.086498:0:14304:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff92cc00d9de00/0xe3dac0c99afff370 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe3dac0c99afff377 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841921.086565:0:14304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e2de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:14304:1874687715011328:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787841921.086596:0:14304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841921.086625:0:14304:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbda4d1000 going to sleep for 11 seconds 00000100:00100000:3.0:1787841921.086674:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715011328 00000100:00100000:3.0:1787841921.086678:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715011328 00000100:00100000:1.0:1787841921.086822:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787841921.086833:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6ff5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+11:14304:x1874687715011328:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787841921.087206:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6ff5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+11:14304:x1874687715011328:12345-0@lo:501:mount.lustre.0 Request processed in 377us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841921.087213:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787841921.087482:0:14304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e2de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:14304:1874687715011328:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787841921.087530:0:14304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e2de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:14304:1874687715011456:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787841921.087570:0:14304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841921.087604:0:14304:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc50000c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787841921.087645:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715011456 00000100:00100000:3.0:1787841921.087650:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715011456 00000100:00100000:3.0:1787841921.087670:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787841921.087676:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6ff6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+11:14304:x1874687715011456:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787841921.087884:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6ff6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+11:14304:x1874687715011456:12345-0@lo:503:mount.lustre.0 Request processed in 208us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841921.087892:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787841921.089115:0:14304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e2de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:14304:1874687715011456:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787841921.096302:0:14348:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac26dfc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:14348:1874687715011584:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787841921.096405:0:14348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841921.096487:0:14348:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc82eda80 going to sleep for 11 seconds 00000100:00100000:3.0:1787841921.106523:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715011584 00000100:00100000:3.0:1787841921.106541:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715011584 00000100:00100000:3.0:1787841921.106607:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787841921.106617:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6ff4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+11:14348:x1874687715011584:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787841921.107953:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6ff4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+11:14348:x1874687715011584:12345-0@lo:502:llog_process_th.0 Request processed in 1322us (11532us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841921.107964:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787841921.108092:0:14348:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac26dfc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:14348:1874687715011584:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787841921.108126:0:14348:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787841921.108136:0:14348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787841921.108138:0:14348:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787841921.108145:0:14348:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff92cac3549800 00000020:00000080:0.0:1787841921.108148:0:14348:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787841921.108155:0:14348:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787841921.108158:0:14348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787841921.108159:0:14348:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787841921.108161:0:14348:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787841921.108164:0:14348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787841921.108165:0:14348:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787841921.108176:0:14348:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff92cac3549800 00000020:00000080:0.0:1787841921.108179:0:14348:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787841921.108249:0:14348:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787841921.108253:0:14348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787841921.108254:0:14348:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1787841921.108257:0:14348:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787841921.108259:0:14348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787841921.108261:0:14348:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787841921.108264:0:14348:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff92cac3549800 00000020:00000080:0.0:1787841921.108267:0:14348:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787841921.108314:0:14348:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac26dfc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:14348:1874687715011712:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787841921.108361:0:14348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841921.108405:0:14348:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc82eda80 going to sleep for 11 seconds 00000100:00100000:1.0:1787841921.108581:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715011712 00000100:00100000:1.0:1787841921.108588:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715011712 00000100:00100000:1.0:1787841921.108625:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787841921.108633:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6ff4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+11:14348:x1874687715011712:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787841921.108831:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6ff4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+11:14348:x1874687715011712:12345-0@lo:502:llog_process_th.0 Request processed in 199us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841921.108838:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787841921.110100:0:14348:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac26dfc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:14348:1874687715011712:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787841921.110150:0:14348:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787841921.110158:0:14348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787841921.110160:0:14348:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1787841921.110164:0:14348:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1787841921.110442:0:14304:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1787841921.110461:0:14304:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787841921.110484:0:14304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cc00d9de00/0xe3dac0c99afff370 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99afff377 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841921.110495:0:14304:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff92cc00d9de00/0xe3dac0c99afff370 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99afff377 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787841921.110542:0:14304:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787841921.110545:0:14304:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff92cac3549800 10000000:01000000:1.0:1787841921.110548:0:14304:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff92cac3549800 10000000:01000000:1.0:1787841921.110552:0:14304:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787841921.110558:0:14304:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff92cac3549800 from 1 10000000:01000000:1.0:1787841921.110561:0:14304:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787841921.110596:0:14304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cc00d9c000/0xe3dac0c99afff37e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841921.110617:0:14304:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff92cc00d9c000/0xe3dac0c99afff37e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841921.110626:0:14304:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff92cc00d9c000/0xe3dac0c99afff37e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841921.110643:0:14304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e2de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:14304:1874687715011840:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787841921.110974:0:14304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841921.113597:0:14304:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc5000300 going to sleep for 11 seconds 00000100:00100000:2.0:1787841921.124654:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715011840 00000100:00100000:2.0:1787841921.124668:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715011840 00000100:00100000:2.0:1787841921.124742:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787841921.124753:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6ff4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+11:14304:x1874687715011840:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787841921.124768:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841921.124786:0:14315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92cbc6105800/0xe3dac0c99afff385 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe3dac0c99afff37e expref: -99 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841921.124811:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92cbc6105800/0xe3dac0c99afff385 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe3dac0c99afff37e expref: 12 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841921.124833:0:14315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92cbc6105800/0xe3dac0c99afff385 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe3dac0c99afff37e expref: 12 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841921.124843:0:14315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc6105800, rc 0) 00000100:00100000:2.0:1787841921.124915:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6ff4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+12:14304:x1874687715011840:12345-0@lo:101:mount.lustre.0 Request processed in 164us (13942us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841921.124922:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787841921.125769:0:14304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e2de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:14304:1874687715011840:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787841921.125789:0:14304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff92cc00d9c000/0xe3dac0c99afff37e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99afff385 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841921.125799:0:14304:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff92cc00d9c000/0xe3dac0c99afff37e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe3dac0c99afff385 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841921.125864:0:14304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac26dfc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:14304:1874687715011968:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787841921.125902:0:14304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841921.125937:0:14304:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbf732bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787841921.126068:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715011968 00000100:00100000:2.0:1787841921.126073:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715011968 00000100:00100000:2.0:1787841921.126119:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787841921.126127:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6ff7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+12:14304:x1874687715011968:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787841921.126518:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6ff7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+12:14304:x1874687715011968:12345-0@lo:501:mount.lustre.0 Request processed in 392us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841921.126526:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787841921.129525:0:14304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac26dfc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:14304:1874687715011968:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787841921.129613:0:14304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac26dfc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:14304:1874687715012096:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787841921.129713:0:14304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841921.130075:0:14304:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbf732bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787841921.130107:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715012096 00000100:00100000:0.0:1787841921.130117:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715012096 00000100:00100000:0.0:1787841921.135884:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787841921.135899:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6ff4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+12:14304:x1874687715012096:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787841921.136185:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6ff4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+12:14304:x1874687715012096:12345-0@lo:503:mount.lustre.0 Request processed in 289us (6487us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841921.136194:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787841921.136366:0:14304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac26dfc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:14304:1874687715012096:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787841921.141585:0:14352:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac26dfc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:14352:1874687715012224:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787841921.141665:0:14352:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841921.141733:0:14352:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbf732bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787841921.142989:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715012224 00000100:00100000:2.0:1787841921.142999:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715012224 00000100:00100000:2.0:1787841921.143052:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787841921.143061:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6ff5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+12:14352:x1874687715012224:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787841921.149511:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6ff5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+12:14352:x1874687715012224:12345-0@lo:502:llog_process_th.0 Request processed in 6444us (7839us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841921.149525:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787841921.149666:0:14352:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac26dfc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:14352:1874687715012224:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1787841921.149799:0:14352:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1787841921.149823:0:14352:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff92cbe9a6b490) 00000020:00000080:3.0:1787841921.149856:0:14352:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:3.0:1787841921.150022:0:14352:0:(tgt_mount.c:153:server_get_mount()) get mount ffff92cac3549800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787841921.150029:0:14352:0:(tgt_mount.c:187:server_put_mount()) put mount ffff92cac3549800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787841921.150034:0:14352:0:(obd_mount.c:710:lustre_put_lsi()) put ffff92cac3549800 4 00010000:00080000:3.0:1787841921.150076:0:14352:0:(ldlm_lib.c:102:import_set_conn()) imp ffff92cbffa76000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.101@tcp at head 00010000:00010000:3.0:1787841921.167410:0:14352:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:3.0:1787841921.167665:0:14352:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1787841921.167782:0:14352:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787841921.167800:0:14352:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xe3dac0c99afff393 00000100:00080000:3.0:1787841921.167811:0:14352:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787841921.167816:0:14352:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff92cbffa76000 using connection 192.168.201.101@tcp/0@lo 00000100:00100000:3.0:1787841921.167853:0:14352:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92cac30912c0 x1874687715012352/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787841921.167895:0:14352:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787841921.167967:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac30912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3297:1874687715012352:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787841921.168037:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841921.171337:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715012352 00000100:00100000:3.0:1787841921.171353:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715012352 00000100:00100000:3.0:1787841921.171397:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787841921.171406:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac3092d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3297:x1874687715012352:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787841921.171508:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac3092d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3297:x1874687715012352:12345-0@lo:38:llog_process_th.0 Request processed in 103us (3470us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787841921.171516:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787841921.171560:0:3297:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787841921.171568:0:3297:0:(import.c:65:import_set_state_nolock()) ffff92cbffa76000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787841921.171572:0:3297:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787841921.171575:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac30912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3297:1874687715012352:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787841921.175935:0:14352:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e2da40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:14352:1874687715012480:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787841921.176042:0:14352:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841921.176077:0:14352:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc5000780 going to sleep for 11 seconds 00000100:00100000:0.0:1787841921.180466:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715012480 00000100:00100000:0.0:1787841921.180478:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715012480 00000100:00100000:0.0:1787841921.180551:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787841921.180571:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6ff6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+12:14352:x1874687715012480:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787841921.180904:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6ff6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+12:14352:x1874687715012480:12345-0@lo:502:llog_process_th.0 Request processed in 341us (4862us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841921.180913:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787841921.180992:0:14352:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e2da40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:14352:1874687715012480:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1787841921.181029:0:14352:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1787841921.181152:0:14304:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1787841921.181179:0:14304:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787841921.181195:0:14304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cc00d9c000/0xe3dac0c99afff37e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99afff385 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841921.181205:0:14304:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff92cc00d9c000/0xe3dac0c99afff37e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99afff385 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787841921.181261:0:14304:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787841921.181264:0:14304:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787841921.181265:0:14304:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787841921.181266:0:14304:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787841921.181267:0:14304:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787841921.181269:0:14304:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787841921.181270:0:14304:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787841921.181272:0:14304:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787841921.181274:0:14304:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787841921.181275:0:14304:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787841921.181278:0:14304:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1787841921.181281:0:14304:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787841921.181282:0:14304:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787841921.181283:0:14304:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787841921.181284:0:14304:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787841921.181286:0:14304:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787841921.181287:0:14304:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787841921.181288:0:14304:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787841921.181289:0:14304:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787841921.181290:0:14304:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787841921.181290:0:14304:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787841921.181307:0:14304:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787841921.181323:0:14304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac26dc780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:14304:1874687715012608:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787841921.181360:0:14304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841921.181401:0:14304:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbf732b6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787841921.182984:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715012608 00000100:00100000:3.0:1787841921.182997:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715012608 00000100:00100000:3.0:1787841921.183053:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787841921.183063:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6ff6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+12:14304:x1874687715012608:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787841921.183107:0:14317:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787841921.183121:0:14317:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787841921.247496:0:14317:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787841921.247513:0:14317:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1787841921.247811:0:14338:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787841921.247817:0:14338:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787841921.247839:0:14338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff92cbc6104000/0xe3dac0c99afff39a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841921.247858:0:14338:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92cc00d9d800/0xe3dac0c99afff369 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe3dac0c99afff362 expref: 12 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841921.247874:0:14338:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff92cbc6104000/0xe3dac0c99afff39a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841921.247918:0:14338:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92cc00d9d800/0xe3dac0c99afff369 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe3dac0c99afff362 expref: 12 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841921.247933:0:14338:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92cc00d9d800/0xe3dac0c99afff369 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe3dac0c99afff362 expref: 12 pid: 14315 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841921.247957:0:14338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff3d0f00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14338:1874687715012736:0@lo:104: 00000100:00100000:2.0:1787841921.248021:0:14338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841921.248064:0:14338:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc52e4840 going to sleep for 11 seconds 00000100:00100000:0.0:1787841921.248329:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715012736 00000100:00100000:0.0:1787841921.248336:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715012736 00000100:00100000:0.0:1787841921.248382:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787841921.248390:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff3d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+3:14338:x1874687715012736:12345-0@lo:104: 00000100:00100000:2.0:1787841921.248391:0:14306:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:2.0:1787841921.248397:0:14306:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:0.0:1787841921.248402:0:14305:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.101@tcp lock: ffff92cbffa3a600/0xe3dac0c99afff362 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe3dac0c99afff369 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841921.248454:0:14305:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787841921.248459:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff3d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+3:14338:x1874687715012736:12345-0@lo:104: Request processed in 72us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841921.248466:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1787841921.248485:0:14311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787841921.248491:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.101@tcp lock: ffff92cbffa3a600/0xe3dac0c99afff362 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe3dac0c99afff369 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841921.248499:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbffa3a600 already unused, calling callback (ffffffffc1d9fc20) 10000000:00010000:0.0:1787841921.248503:0:14311:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.101@tcp lock: ffff92cbffa3a600/0xe3dac0c99afff362 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe3dac0c99afff369 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841921.248512:0:14311:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.101@tcp lock: ffff92cbffa3a600/0xe3dac0c99afff362 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe3dac0c99afff369 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787841921.248520:0:14311:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.101@tcp lock: ffff92cbffa3a600/0xe3dac0c99afff362 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe3dac0c99afff369 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787841921.248526:0:14311:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787841921.248553:0:14311:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.101@tcp lock: ffff92cbffa3a600/0xe3dac0c99afff362 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99afff369 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841921.248560:0:14311:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787841921.248582:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.101@tcp lock: ffff92cbffa3a600/0xe3dac0c99afff362 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99afff369 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841921.248599:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.101@tcp lock: ffff92cbffa3a600/0xe3dac0c99afff362 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99afff369 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841921.248613:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841921.248615:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841921.248617:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787841921.248637:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac26dda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:3300:1874687715012864:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787841921.248664:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841921.248778:0:14338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff3d0f00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14338:1874687715012736:0@lo:104: 00010000:00010000:0.0:1787841921.248797:0:14338:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff92cbc6104000/0xe3dac0c99afff39a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841921.249354:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715012864 00000100:00100000:1.0:1787841921.249360:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715012864 00010000:00010000:1.0:1787841921.249378:0:14307:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92cc00d9d800/0xe3dac0c99afff369 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe3dac0c99afff362 expref: 13 pid: 14315 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841921.249404:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787841921.249408:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac26dd680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+13:3300:x1874687715012864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787841921.249417:0:14307:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787841921.249420:0:14307:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92cc00d9d800/0xe3dac0c99afff369 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe3dac0c99afff362 expref: 13 pid: 14315 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841921.249427:0:14307:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92cc00d9d800/0xe3dac0c99afff369 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe3dac0c99afff362 expref: 13 pid: 14315 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841921.249437:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92cc00d9d800/0xe3dac0c99afff369 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe3dac0c99afff362 expref: 13 pid: 14315 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841921.249453:0:14307:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff92cbc6104000/0xe3dac0c99afff39a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841921.249458:0:14307:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92cbc6104000/0xe3dac0c99afff39a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787841921.249467:0:14307:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001652303s 00010000:00010000:1.0:1787841921.249470:0:14307:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92cbc6104000/0xe3dac0c99afff39a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841921.249474:0:14307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92cbc6104000/0xe3dac0c99afff39a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841921.249479:0:14307:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff92cbc6104000/0xe3dac0c99afff39a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841921.249482:0:14307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff92cbc6104000/0xe3dac0c99afff39a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841921.249486:0:14307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6104000 already unused, calling callback (ffffffffc17a4500) 00010000:00010000:1.0:1787841921.249489:0:14307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff92cbc6104000/0xe3dac0c99afff39a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841921.249493:0:14307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff92cbc6104000/0xe3dac0c99afff39a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841921.249507:0:14307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff92cbc6104000/0xe3dac0c99afff39a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841921.249515:0:14307:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787841921.249533:0:14338:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff92cbc6104000/0xe3dac0c99afff39a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841921.249540:0:14338:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff92cbc6104000/0xe3dac0c99afff39a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841921.249546:0:14338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92cbc6104000/0xe3dac0c99afff39a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841921.249556:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac26dd680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+12:3300:x1874687715012864:12345-0@lo:103:ldlm_bl.0 Request processed in 147us (891us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841921.249563:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787841921.249837:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac26dda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:3300:1874687715012864:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787841921.256195:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6ff6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+11:14304:x1874687715012608:12345-0@lo:253:mount.lustre.0 Request processed in 73124us (74824us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841921.256210:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787841921.256498:0:14304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac26dc780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:14304:1874687715012608:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787841921.256515:0:14304:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787841921.256518:0:14304:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787841921.256520:0:14304:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787841921.256521:0:14304:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787841921.256522:0:14304:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787841921.256524:0:14304:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787841921.256525:0:14304:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787841921.256526:0:14304:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787841921.256528:0:14304:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787841921.256530:0:14304:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787841921.256531:0:14304:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787841921.256548:0:14304:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1787841921.262856:0:14304:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1787841921.263015:0:14304:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1787841921.263340:0:14304:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1787841921.263498:0:14304:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787841921.263799:0:14304:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1787841921.263967:0:14304:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1787841921.265492:0:14304:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1787841921.265634:0:14304:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1787841921.266093:0:14304:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1787841921.266464:0:14304:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1787841921.267006:0:14304:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1787841921.267170:0:14304:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:2.0:1787841921.300043:0:14304:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1787841921.300518:0:14304:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1787841921.300811:0:14361:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:0.0:1787841921.300816:0:14361:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:2.0:1787841921.301031:0:14362:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:2.0:1787841921.301106:0:14362:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787841921.304053:0:14362:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787841921.304149:0:14362:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1787841921.304153:0:14362:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:3.0:1787841921.308398:0:14304:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1787841921.308523:0:14304:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1787841921.309757:0:14304:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1787841921.309781:0:14304:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1787841921.309997:0:14304:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787841921.311423:0:14304:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1787841921.312055:0:14304:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1787841921.312093:0:14304:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:3.0:1787841921.314276:0:14304:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:3.0:1787841921.318535:0:14304:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1787841921.347936:0:14304:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1787841921.347986:0:14304:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa5d880da3988 00100000:10000000:2.0:1787841921.347994:0:14304:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1787841921.349523:0:14304:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787841921.349538:0:14304:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.101@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787841921.349552:0:14304:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1787841921.349570:0:14304:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:0.0:1787841921.672196:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787841922.050841:0:14319:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787841922.050848:0:14319:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff92cac3549800 from 6 10000000:01000000:2.0:1787841922.050852:0:14319:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787841922.050898:0:14319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc6105000/0xe3dac0c99afff3a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841922.050909:0:14319:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff92cbc6105000/0xe3dac0c99afff3a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841922.050920:0:14319:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff92cbc6105000/0xe3dac0c99afff3a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841922.050956:0:14319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff3d1a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:14319:1874687715012992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787841922.051032:0:14319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841922.051072:0:14319:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc52e4840 going to sleep for 11 seconds 00000100:00100000:0.0:1787841922.051328:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715012992 00000100:00100000:0.0:1787841922.051336:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715012992 00000100:00100000:0.0:1787841922.051392:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787841922.051401:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6ff7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+11:14319:x1874687715012992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787841922.051414:0:14316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841922.051427:0:14316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92cbffa3ae00/0xe3dac0c99afff3a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe3dac0c99afff3a1 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841922.051450:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92cbffa3ae00/0xe3dac0c99afff3a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe3dac0c99afff3a1 expref: 12 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841922.051461:0:14316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92cbffa3ae00/0xe3dac0c99afff3a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe3dac0c99afff3a1 expref: 12 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841922.051470:0:14316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbffa3ae00, rc 0) 00000100:00100000:0.0:1787841922.051513:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6ff7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+12:14319:x1874687715012992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841922.051533:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787841922.051624:0:14319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff3d1a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:14319:1874687715012992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787841922.051636:0:14319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff92cbc6105000/0xe3dac0c99afff3a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99afff3a8 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841922.051645:0:14319:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff92cbc6105000/0xe3dac0c99afff3a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe3dac0c99afff3a8 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841922.051687:0:14319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff3d1a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:14319:1874687715013120:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787841922.051878:0:14319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841922.051897:0:14319:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc52e4840 going to sleep for 11 seconds 00000100:00100000:0.0:1787841922.052267:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715013120 00000100:00100000:0.0:1787841922.052274:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715013120 00000100:00100000:0.0:1787841922.052311:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787841922.052318:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf8eb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+12:14319:x1874687715013120:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787841922.052333:0:14317:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787841922.052349:0:14317:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787841922.052352:0:14317:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1787841922.052433:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf8eb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+12:14319:x1874687715013120:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 114us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841922.052440:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787841922.056227:0:14319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff3d1a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:14319:1874687715013120:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787841922.056297:0:14319:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787841922.056309:0:14319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc6105000/0xe3dac0c99afff3a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99afff3a8 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841922.056320:0:14319:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff92cbc6105000/0xe3dac0c99afff3a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99afff3a8 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787841922.178998:0:14354:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787841922.689638:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787841923.216543:0:14354:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787841923.725319:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841924.737402:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841925.761924:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787841926.413977:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787841926.413990:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787841926.413993:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787841926.413996:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787841926.413998:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787841926.414002:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787841926.414005:0:38:0:(import.c:65:import_set_state_nolock()) ffff92cbffa76000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787841926.414018:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff92cbffa76000 using connection 192.168.201.101@tcp/0@lo 00000100:00100000:2.0:1787841926.414041:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92cbff3d03c0 x1874687715013376/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787841926.414079:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff3d21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:3301:1874687715013248:0@lo:400:kworker.0 00000100:00100000:2.0:1787841926.414170:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841926.414239:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff3d03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3297:1874687715013376:0@lo:38:kworker.0 00000100:00100000:2.0:1787841926.414269:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841926.414298:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715013248 00000100:00100000:2.0:1787841926.414305:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715013248 00000100:00100000:2.0:1787841926.414343:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787841926.414351:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf8eb7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+12:3301:x1874687715013248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841926.414396:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf8eb7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+12:3301:x1874687715013248:12345-0@lo:400:kworker.0 Request processed in 45us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841926.414403:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787841926.414441:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715013376 00000100:00100000:2.0:1787841926.414445:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715013376 00000100:00100000:2.0:1787841926.414462:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787841926.414466:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff3d1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3297:x1874687715013376:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1787841926.414494:0:14324:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 466 last 0 00000020:00000080:2.0:1787841926.414525:0:14324:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xe3dac0c99afff3af 00000004:00100000:2.0:1787841926.414540:0:14324:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787841926.418517:0:14324:0:(import.c:65:import_set_state_nolock()) ffff92cc00d81000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787841926.418781:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff3d1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1874687715013376:12345-0@lo:38:kworker.0 Request processed in 4308us (4506us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841926.418792:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787841926.418871:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff92cbff3d03c0 x1874687715013376/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787841936 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787841926.418887:0:3297:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1787841926.418896:0:3297:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1787841926.418900:0:3297:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787841926.418902:0:3297:0:(import.c:65:import_set_state_nolock()) ffff92cbffa76000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787841926.418908:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff3d03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3297:1874687715013376:0@lo:38:kworker.0 00000100:00100000:2.0:1787841926.418939:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff3d21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:3301:1874687715013248:0@lo:400:kworker.0 00010000:00010000:0.0:1787841926.786241:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787841927.418124:0:14605:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg101-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787841927.809033:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841928.832948:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841929.858045:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841930.884125:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787841931.213655:0:14756:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe93fab2f0 20000000:00000080:2.0:1787841931.213679:0:14756:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff92cbfa94a800 uarg=0000000000000000 20000000:01000000:2.0:1787841931.213751:0:14756:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1787841931.213761:0:14756:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1787841931.213778:0:14756:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1787841931.214934:0:14757:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:0.0:1787841931.215385:0:14756:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1787841931.224431:0:14756:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787841931.225689:0:14756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff92cc00d9d600/0xe3dac0c99afff3b6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841931.225753:0:14756:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92cbc149d600/0xe3dac0c99afff377 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe3dac0c99afff370 expref: 11 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841931.225764:0:14756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff92cc00d9d600/0xe3dac0c99afff3b6 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841931.225846:0:14756:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92cbc149d600/0xe3dac0c99afff377 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe3dac0c99afff370 expref: 11 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841931.225865:0:14756:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92cbc149d600/0xe3dac0c99afff377 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe3dac0c99afff370 expref: 11 pid: 14317 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841931.225884:0:14756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e2e1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14756:1874687715013504:0@lo:104: 00000100:00100000:1.0:1787841931.225986:0:14756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841931.226068:0:14756:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc942b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787841931.226177:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715013504 00000100:00100000:3.0:1787841931.226188:0:14306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715013504 00000100:00100000:3.0:1787841931.226259:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787841931.226273:0:14306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e2f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+3:14756:x1874687715013504:12345-0@lo:104: 00010000:00010000:3.0:1787841931.226289:0:14306:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.101@tcp lock: ffff92cc00d9de00/0xe3dac0c99afff370 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe3dac0c99afff377 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841931.226371:0:14306:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787841931.226377:0:14306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e2f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+3:14756:x1874687715013504:12345-0@lo:104: Request processed in 109us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841931.226402:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1787841931.226486:0:14310:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787841931.226500:0:14310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.101@tcp lock: ffff92cc00d9de00/0xe3dac0c99afff370 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe3dac0c99afff377 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841931.226531:0:14310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cc00d9de00 already unused, calling callback (ffffffffc1d9fc20) 10000000:00010000:0.0:1787841931.226540:0:14310:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.101@tcp lock: ffff92cc00d9de00/0xe3dac0c99afff370 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe3dac0c99afff377 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841931.226581:0:14310:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.101@tcp lock: ffff92cc00d9de00/0xe3dac0c99afff370 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe3dac0c99afff377 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787841931.226596:0:14310:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.101@tcp lock: ffff92cc00d9de00/0xe3dac0c99afff370 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe3dac0c99afff377 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787841931.226605:0:14310:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787841931.226683:0:14310:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.101@tcp lock: ffff92cc00d9de00/0xe3dac0c99afff370 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99afff377 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841931.226692:0:14310:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787841931.226834:0:14310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.101@tcp lock: ffff92cc00d9de00/0xe3dac0c99afff370 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99afff377 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841931.226838:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac26ded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:3298:1874687715013632:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787841931.226851:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.101@tcp lock: ffff92cc00d9de00/0xe3dac0c99afff370 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99afff377 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841931.226872:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841931.226874:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841931.226876:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787841931.227169:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841931.227277:0:14756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e2e1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14756:1874687715013504:0@lo:104: 00000100:00100000:0.0:1787841931.227277:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715013632 00000100:00100000:0.0:1787841931.227285:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715013632 00010000:00010000:1.0:1787841931.227317:0:14756:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff92cc00d9d600/0xe3dac0c99afff3b6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841931.227318:0:14307:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92cbc149d600/0xe3dac0c99afff377 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe3dac0c99afff370 expref: 12 pid: 14317 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841931.229286:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787841931.229311:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff3d21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+12:3298:x1874687715013632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787841931.229334:0:14307:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787841931.229347:0:14307:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92cbc149d600/0xe3dac0c99afff377 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe3dac0c99afff370 expref: 12 pid: 14317 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841931.229366:0:14307:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92cbc149d600/0xe3dac0c99afff377 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe3dac0c99afff370 expref: 12 pid: 14317 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841931.229390:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92cbc149d600/0xe3dac0c99afff377 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe3dac0c99afff370 expref: 12 pid: 14317 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841931.229413:0:14307:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff92cc00d9d600/0xe3dac0c99afff3b6 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841931.229432:0:14307:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92cc00d9d600/0xe3dac0c99afff3b6 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841931.229454:0:14307:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92cc00d9d600/0xe3dac0c99afff3b6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841931.229462:0:14307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92cc00d9d600/0xe3dac0c99afff3b6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841931.229469:0:14307:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff92cc00d9d600/0xe3dac0c99afff3b6 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841931.229476:0:14307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff92cc00d9d600/0xe3dac0c99afff3b6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841931.229494:0:14307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cc00d9d600 already unused, calling callback (ffffffffc17a4500) 00010000:00010000:3.0:1787841931.229498:0:14307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff92cc00d9d600/0xe3dac0c99afff3b6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841931.229511:0:14307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff92cc00d9d600/0xe3dac0c99afff3b6 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841931.253417:0:14756:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff92cc00d9d600/0xe3dac0c99afff3b6 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841931.253444:0:14756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff92cc00d9d600/0xe3dac0c99afff3b6 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841931.255938:0:14307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff92cc00d9d600/0xe3dac0c99afff3b6 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841931.255965:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92cc00d9d600/0xe3dac0c99afff3b6 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841931.255996:0:14307:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787841931.256157:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff3d21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+11:3298:x1874687715013632:12345-0@lo:103:ldlm_bl.0 Request processed in 26848us (28977us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841931.256177:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787841931.256193:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac26ded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:3298:1874687715013632:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787841931.525237:0:3297:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787841921/real 1787841921] req@ffff92cac26dc000 x1874687715010688/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787841931 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787841931.525276:0:3297:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff92cac26dc000 x1874687715010688/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787841931 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787841931.525309:0:3297:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787841921/real 1787841921] req@ffff92cbf6e2d2c0 x1874687715010432/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787841931 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787841931.525323:0:3297:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff92cbf6e2d2c0 x1874687715010432/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787841931 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787841931.525344:0:3297:0:(import.c:65:import_set_state_nolock()) ffff92cbff853000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787841931.525514:0:3297:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787841931.525520:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac26dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1874687715010688:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1787841931.525527:0:3297:0:(import.c:65:import_set_state_nolock()) ffff92cbc7985000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787841931.525532:0:3297:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787841931.525535:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e2d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1874687715010432:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1787841931.525588:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787841931.525593:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787841931.525596:0:36:0:(import.c:65:import_set_state_nolock()) ffff92cbc7985000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787841931.525601:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 461 00000100:00080000:2.0:1787841931.525607:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787841931.525615:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff92cbc7985000 using connection 192.168.201.101@tcp/0@lo 00000100:00100000:2.0:1787841931.525656:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92cbff3d03c0 x1874687715013760/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787841931.525684:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787841931.525688:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787841931.525689:0:36:0:(import.c:65:import_set_state_nolock()) ffff92cbff853000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787841931.525692:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 461 00000100:00080000:2.0:1787841931.525729:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787841931.525734:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff92cbff853000 using connection 192.168.201.101@tcp/0@lo 00000100:00100000:2.0:1787841931.525750:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92cbff3d2580 x1874687715013888/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787841931.525853:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff3d0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874687715014016:0@lo:400:kworker.0 00000100:00100000:1.0:1787841931.525949:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841931.526328:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff3d03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1874687715013760:0@lo:8:kworker.0 00000400:00000100:0.0:1787841931.526380:0:3297:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874687715013760 offset 0 length 520: 4 00000100:00100000:0.0:1787841931.526404:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff3d2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1874687715013888:0@lo:8:kworker.0 00000400:00000100:0.0:1787841931.526430:0:3297:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874687715013888 offset 0 length 520: 4 00000100:00100000:1.0:1787841931.527346:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715014016 00000100:00100000:1.0:1787841931.527374:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715014016 00000100:00100000:1.0:1787841931.527437:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787841931.527449:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e2e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874687715014016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841931.527669:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e2e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874687715014016:12345-0@lo:400:kworker.0 Request processed in 222us (1719us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841931.527678:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787841931.528012:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff92cbff3d0b40 x1874687715014016/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787841947 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787841931.528031:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff3d0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874687715014016:0@lo:400:kworker.0 00010000:00010000:0.0:1787841931.910310:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841932.929054:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787841933.057014:0:14319:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787841933.057028:0:14319:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92cac3549800 from 10 10000000:01000000:2.0:1787841933.057036:0:14319:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787841933.057107:0:14319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc6105200/0xe3dac0c99afff3bd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841933.057122:0:14319:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff92cbc6105200/0xe3dac0c99afff3bd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841933.057136:0:14319:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff92cbc6105200/0xe3dac0c99afff3bd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841933.057171:0:14319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff3d3c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:14319:1874687715014144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787841933.057271:0:14319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841933.057348:0:14319:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc52e4c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787841933.057826:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715014144 00000100:00100000:1.0:1787841933.057837:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715014144 00000100:00100000:1.0:1787841933.057914:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787841933.057932:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf8eb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+11:14319:x1874687715014144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787841933.057951:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841933.057972:0:14315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92cc00d9de00/0xe3dac0c99afff3c4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe3dac0c99afff3bd expref: -99 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841933.058005:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92cc00d9de00/0xe3dac0c99afff3c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe3dac0c99afff3bd expref: 12 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841933.058019:0:14315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92cc00d9de00/0xe3dac0c99afff3c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe3dac0c99afff3bd expref: 12 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841933.058030:0:14315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cc00d9de00, rc 0) 00000100:00100000:1.0:1787841933.058091:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf8eb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+12:14319:x1874687715014144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 161us (820us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841933.058119:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787841933.058569:0:14319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff3d3c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:14319:1874687715014144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787841933.058594:0:14319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff92cbc6105200/0xe3dac0c99afff3bd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99afff3c4 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841933.058605:0:14319:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff92cbc6105200/0xe3dac0c99afff3bd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe3dac0c99afff3c4 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841933.058688:0:14319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac26dda40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:14319:1874687715014272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787841933.058772:0:14319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841933.058826:0:14319:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbe76b4600 going to sleep for 11 seconds 00000100:00100000:2.0:1787841933.059329:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715014272 00000100:00100000:2.0:1787841933.059337:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715014272 00000100:00100000:2.0:1787841933.059388:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787841933.059398:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf8eb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+12:14319:x1874687715014272:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787841933.059820:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf8eb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+12:14319:x1874687715014272:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 413us (1038us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841933.059830:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787841933.061194:0:14319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac26dda40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:14319:1874687715014272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787841933.061282:0:14319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac26dda40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:14319:1874687715014400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787841933.061354:0:14319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841933.061407:0:14319:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbe76b4600 going to sleep for 11 seconds 00000100:00100000:1.0:1787841933.061474:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715014400 00000100:00100000:1.0:1787841933.061480:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715014400 00000100:00100000:1.0:1787841933.061537:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787841933.061546:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf8eb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+12:14319:x1874687715014400:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787841933.061786:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf8eb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+12:14319:x1874687715014400:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 241us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841933.061795:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787841933.061939:0:14319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac26dda40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:14319:1874687715014400:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787841933.062957:0:14818:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1787841933.063031:0:14319:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1787841933.063056:0:14319:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787841933.063070:0:14319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc6105200/0xe3dac0c99afff3bd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99afff3c4 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841933.063098:0:14319:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff92cbc6105200/0xe3dac0c99afff3bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99afff3c4 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787841933.442574:0:14354:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787841933.953048:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841934.978287:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841936.014002:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787841936.640877:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787841936.640887:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787841936.640898:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787841936.640901:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787841936.640951:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff3d3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874687715014656:0@lo:400:kworker.0 00000100:00100000:2.0:1787841936.641067:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841936.641310:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787841936.641318:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff3d0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:3301:1874687715014528:0@lo:400:kworker.0 00000100:00100000:2.0:1787841936.641359:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841936.641406:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715014656 00000100:00100000:2.0:1787841936.641415:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715014656 00000100:00100000:2.0:1787841936.641481:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787841936.641492:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff3d30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874687715014656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841936.641568:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff3d30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874687715014656:12345-0@lo:400:kworker.0 Request processed in 77us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841936.641575:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787841936.641608:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715014528 00000100:00100000:2.0:1787841936.641612:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715014528 00000100:00100000:2.0:1787841936.641641:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787841936.641647:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf8eb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+12:3301:x1874687715014528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841936.641692:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf8eb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+12:3301:x1874687715014528:12345-0@lo:400:kworker.0 Request processed in 45us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841936.641722:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787841936.641777:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff3d0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:3301:1874687715014528:0@lo:400:kworker.0 00010000:00080000:2.0:1787841936.641793:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff92cbff3d3840 x1874687715014656/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787841952 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787841936.641806:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff3d3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874687715014656:0@lo:400:kworker.0 00010000:00010000:0.0:1787841937.025105:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787841937.383926:0:15004:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787841937.383932:0:15004:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1787841937.384384:0:15004:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff92cbf71ac000 00000020:01000004:0.0:1787841937.384427:0:15004:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1787841937.384443:0:15004:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1787841937.384463:0:15004:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff92cbffa43490) 00000020:00000080:0.0:1787841937.384482:0:15004:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787841937.418898:0:15004:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787841937.419592:0:15004:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1787841937.420856:0:15004:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787841937.421372:0:15004:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1787841937.421620:0:15004:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1787841937.425763:0:15004:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 407: rc = 0 00100000:10000000:2.0:1787841937.425873:0:15004:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 407: rc = 0 00100000:10000000:2.0:1787841937.426026:0:15004:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 407: rc = 0 00100000:10000000:2.0:1787841937.426463:0:15004:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 642: rc = 0 00100000:10000000:2.0:1787841937.426877:0:15004:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 642: rc = 0 00100000:10000000:2.0:1787841937.427163:0:15004:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 642: rc = 0 00100000:10000000:2.0:1787841937.427444:0:15004:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 642: rc = 0 00100000:10000000:2.0:1787841937.427768:0:15004:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 642: rc = 0 00100000:10000000:2.0:1787841937.428058:0:15004:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 642: rc = 0 00000020:00000080:2.0:1787841937.430890:0:15004:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1787841937.430908:0:15004:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787841937.430925:0:15004:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xe3dac0c99afff3d2 00000020:01000004:2.0:1787841937.430938:0:15004:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1787841937.430968:0:15004:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.101@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787841937.430972:0:15004:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.101@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787841937.430980:0:15004:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1787841937.430986:0:15004:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1787841937.431002:0:15004:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff92cac218b490) 00000020:00000080:2.0:1787841937.431015:0:15004:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:2.0:1787841937.435082:0:15004:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787841937.435275:0:15004:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1787841937.435280:0:15004:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1787841937.436374:0:15004:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1787841937.436393:0:15004:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1787841937.437975:0:15004:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1787841937.437999:0:15004:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1787841937.443481:0:15004:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787841937.444398:0:15004:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1787841937.444407:0:15004:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1787841937.447937:0:15004:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1787841937.447957:0:15004:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1787841937.494609:0:15004:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787841937.495093:0:15004:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1787841937.495101:0:15004:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1787841937.501914:0:15004:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787841937.501935:0:15004:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1787841937.508317:0:15004:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787841937.508342:0:15004:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1787841937.518347:0:15004:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787841937.518596:0:15004:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1787841937.518603:0:15004:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1787841937.521506:0:15004:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1787841937.521528:0:15004:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1787841937.625239:0:15004:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787841937.625538:0:15004:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1787841937.625546:0:15004:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1787841937.628219:0:15004:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1787841937.628240:0:15004:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1787841937.629015:0:15004:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1787841937.629041:0:15004:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1787841937.629048:0:15004:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.101@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1787841937.653053:0:15004:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.101@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787841937.653205:0:15004:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.101@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1787841937.653210:0:15004:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787841937.653212:0:15004:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787841937.653214:0:15004:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787841937.653215:0:15004:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787841937.653216:0:15004:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787841937.653218:0:15004:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787841937.653219:0:15004:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787841937.653221:0:15004:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787841937.653223:0:15004:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787841937.653226:0:15004:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1787841937.653229:0:15004:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787841937.653230:0:15004:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787841937.653231:0:15004:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787841937.653232:0:15004:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787841937.653233:0:15004:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787841937.653234:0:15004:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787841937.653235:0:15004:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787841937.653236:0:15004:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787841937.653237:0:15004:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787841937.653275:0:15004:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1787841937.653298:0:15004:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac26dd2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:15004:1874687715014784:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787841937.653451:0:15004:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841937.653574:0:15004:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc675ecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787841937.653918:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715014784 00000100:00100000:1.0:1787841937.653925:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715014784 00000100:00100000:1.0:1787841937.654042:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787841937.654054:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf8eb5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+12:15004:x1874687715014784:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787841937.654100:0:14315:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1787841937.654103:0:14315:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1787841937.654107:0:14315:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1787841937.663568:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf8eb5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+12:15004:x1874687715014784:12345-0@lo:253:mount.lustre.0 Request processed in 9508us (10108us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841937.663594:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787841937.663853:0:15004:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac26dd2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:15004:1874687715014784:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787841937.663869:0:15004:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787841937.663872:0:15004:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787841937.663874:0:15004:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787841937.663876:0:15004:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787841937.663877:0:15004:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787841937.663878:0:15004:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787841937.663893:0:15004:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787841937.663895:0:15004:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787841937.663897:0:15004:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787841937.663898:0:15004:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787841937.663916:0:15004:0:(tgt_mount.c:101:server_register_mount()) register mount ffff92cbf71ac000 from lustre-OST0000 10000000:01000000:1.0:1787841937.663948:0:15004:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1787841937.663951:0:15004:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787841937.663958:0:15004:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff92cbe9a68000 local copy 00010000:00010000:1.0:1787841937.663968:0:15004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc149d400/0xe3dac0c99afff2c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99afff2cf expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841937.664274:0:15004:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e2c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:15004:1874687715014912:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787841937.664320:0:15004:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841937.664959:0:15004:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbd3197540 going to sleep for 11 seconds 00000100:00100000:3.0:1787841937.665214:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715014912 00000100:00100000:3.0:1787841937.665223:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715014912 00000100:00100000:3.0:1787841937.665274:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787841937.665284:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf8eb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+12:15004:x1874687715014912:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787841937.667562:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf8eb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+12:15004:x1874687715014912:12345-0@lo:501:mount.lustre.0 Request processed in 2270us (3232us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787841937.667579:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787841937.672401:0:15004:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e2c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:15004:1874687715014912:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787841937.672446:0:15004:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.101@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787841937.672820:0:15004:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.101@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787841937.672831:0:15004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc149d400/0xe3dac0c99afff2c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99afff2cf expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841937.672842:0:15004:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff92cbc149d400/0xe3dac0c99afff2c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99afff2cf expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787841937.672869:0:15004:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff92cbf71ac000 10000000:01000000:1.0:1787841937.672875:0:15004:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787841937.672880:0:15004:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff92cbe9a68000 10000000:01000000:1.0:1787841937.672883:0:15004:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1787841937.672886:0:15004:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff92cbe9a68000 from 1 10000000:01000000:1.0:1787841937.672890:0:15004:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1787841937.672924:0:15004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cc00d9c200/0xe3dac0c99afff3e0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841937.672940:0:15004:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff92cc00d9c200/0xe3dac0c99afff3e0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841937.672952:0:15004:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff92cc00d9c200/0xe3dac0c99afff3e0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841937.672973:0:15004:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e2c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:15004:1874687715015040:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787841937.673040:0:15004:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841937.673366:0:15004:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbd3197540 going to sleep for 11 seconds 00000100:00100000:0.0:1787841937.673621:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715015040 00000100:00100000:0.0:1787841937.673629:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715015040 00000100:00100000:0.0:1787841937.673737:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787841937.673757:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf8eb6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+12:15004:x1874687715015040:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787841937.673772:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841937.673791:0:14315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92cbffa3b400/0xe3dac0c99afff3e7 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe3dac0c99afff3e0 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841937.673816:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92cbffa3b400/0xe3dac0c99afff3e7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe3dac0c99afff3e0 expref: 13 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841937.673827:0:14315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92cbffa3b400/0xe3dac0c99afff3e7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe3dac0c99afff3e0 expref: 13 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841937.673836:0:14315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbffa3b400, rc 0) 00000100:00100000:0.0:1787841937.673885:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf8eb6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+13:15004:x1874687715015040:12345-0@lo:101:mount.lustre.0 Request processed in 131us (845us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841937.673891:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787841937.674191:0:15004:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e2c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:15004:1874687715015040:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787841937.674207:0:15004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff92cc00d9c200/0xe3dac0c99afff3e0 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99afff3e7 expref: -99 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841937.674214:0:15004:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff92cc00d9c200/0xe3dac0c99afff3e0 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe3dac0c99afff3e7 expref: -99 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787841937.674234:0:15004:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1787841937.674255:0:15004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cc00d9c200/0xe3dac0c99afff3e0 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99afff3e7 expref: -99 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841937.674263:0:15004:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff92cc00d9c200/0xe3dac0c99afff3e0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99afff3e7 expref: -99 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787841937.674271:0:15004:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787841937.674277:0:15004:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787841937.674282:0:15004:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1787841937.674284:0:15004:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787841937.674305:0:15004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc6105e00/0xe3dac0c99afff3ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841937.674312:0:15004:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff92cbc6105e00/0xe3dac0c99afff3ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841937.674319:0:15004:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff92cbc6105e00/0xe3dac0c99afff3ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841937.674335:0:15004:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff3d3840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:15004:1874687715015168:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787841937.674379:0:15004:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841937.674442:0:15004:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc4dcae40 going to sleep for 11 seconds 00000100:00100000:1.0:1787841937.675237:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715015168 00000100:00100000:1.0:1787841937.675245:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715015168 00000100:00100000:1.0:1787841937.675296:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787841937.675304:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf8eb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+13:15004:x1874687715015168:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787841937.675315:0:14316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841937.675327:0:14316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92cc00d9c600/0xe3dac0c99afff3f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe3dac0c99afff3ee expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841937.675358:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92cc00d9c600/0xe3dac0c99afff3f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe3dac0c99afff3ee expref: 14 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841937.675367:0:14316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92cc00d9c600/0xe3dac0c99afff3f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe3dac0c99afff3ee expref: 14 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841937.675374:0:14316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cc00d9c600, rc 0) 00000100:00100000:1.0:1787841937.675416:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf8eb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+14:15004:x1874687715015168:12345-0@lo:101:mount.lustre.0 Request processed in 113us (1037us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841937.675423:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787841937.677067:0:15004:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff3d3840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:15004:1874687715015168:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787841937.677097:0:15004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff92cbc6105e00/0xe3dac0c99afff3ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99afff3f5 expref: -99 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841937.677109:0:15004:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff92cbc6105e00/0xe3dac0c99afff3ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe3dac0c99afff3f5 expref: -99 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787841937.677950:0:15004:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1787841937.678867:0:15004:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787841937.679145:0:15004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1787841937.679187:0:15004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1787841937.679222:0:15004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1787841937.679287:0:15004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1787841937.679324:0:15004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1787841937.679353:0:15004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1787841937.679407:0:15004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1787841937.679415:0:15004:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1787841937.679496:0:15004:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff3d3840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:15004:1874687715015296:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787841937.679562:0:15004:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841937.679622:0:15004:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbda4d1000 going to sleep for 11 seconds 00000100:00100000:3.0:1787841937.680302:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715015296 00000100:00100000:3.0:1787841937.680311:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715015296 00000100:00100000:3.0:1787841937.680366:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787841937.680375:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cc01d23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+14:15004:x1874687715015296:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787841937.681164:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cc01d23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+14:15004:x1874687715015296:12345-0@lo:501:mount.lustre.0 Request processed in 787us (1598us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841937.681175:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787841937.684279:0:15004:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff3d3840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:15004:1874687715015296:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787841937.684418:0:15004:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff3d3840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:15004:1874687715015424:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787841937.684512:0:15004:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841937.684565:0:15004:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbda4d1000 going to sleep for 11 seconds 00000100:00100000:0.0:1787841937.684674:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715015424 00000100:00100000:0.0:1787841937.684681:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715015424 00000100:00100000:0.0:1787841937.684776:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787841937.684786:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cc01d23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+14:15004:x1874687715015424:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787841937.685187:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cc01d23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+14:15004:x1874687715015424:12345-0@lo:503:mount.lustre.0 Request processed in 401us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841937.685205:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787841937.685823:0:15004:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff3d3840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:15004:1874687715015424:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787841937.686893:0:15004:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787841937.686994:0:15004:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff3d3840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:15004:1874687715015552:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787841937.687071:0:15004:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841937.687160:0:15004:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbd13d5540 going to sleep for 11 seconds 00000100:00100000:0.0:1787841937.687209:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715015552 00000100:00100000:0.0:1787841937.687216:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715015552 00000100:00100000:0.0:1787841937.687302:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787841937.687311:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cc01d22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+14:15004:x1874687715015552:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787841937.687902:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cc01d22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+14:15004:x1874687715015552:12345-0@lo:502:mount.lustre.0 Request processed in 589us (828us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841937.687910:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787841937.687994:0:15004:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff3d3840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:15004:1874687715015552:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787841937.688258:0:15004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1787841937.688310:0:15004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1787841937.688424:0:15004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1787841937.688476:0:15004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1787841937.688514:0:15004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1787841937.688548:0:15004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1787841937.688788:0:15004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1787841937.688830:0:15004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1787841937.688865:0:15004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1787841937.688933:0:15004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:2.0:1787841937.688976:0:15004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:2.0:1787841937.689020:0:15004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:2.0:1787841937.689057:0:15004:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff3d3840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:15004:1874687715015680:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787841937.689117:0:15004:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841937.689328:0:15004:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbda4d1000 going to sleep for 11 seconds 00000100:00100000:3.0:1787841937.689454:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715015680 00000100:00100000:3.0:1787841937.689463:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715015680 00000100:00100000:3.0:1787841937.689554:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787841937.689564:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cc01d22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+14:15004:x1874687715015680:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787841937.689819:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cc01d22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+14:15004:x1874687715015680:12345-0@lo:502:mount.lustre.0 Request processed in 256us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841937.689826:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787841937.689924:0:15004:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff3d3840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:15004:1874687715015680:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787841937.690017:0:15004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:0.0:1787841937.690029:0:15004:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:0.0:1787841937.691082:0:15018:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787841937.691091:0:15018:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1787841937.691097:0:15018:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787841937.691100:0:15018:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1787841937.691107:0:15018:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787841937.691124:0:15018:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff92cbe9988000) 00000020:00000080:0.0:1787841937.691152:0:15018:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787841937.691158:0:15018:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787841937.691237:0:15018:0:(tgt_mount.c:153:server_get_mount()) get mount ffff92cbf71ac000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1787841937.691245:0:15018:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787841937.691253:0:15018:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xe3dac0c99afff403 00010000:00010000:1.0:1787841937.698558:0:15018:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:1.0:1787841937.700130:0:15018:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:1.0:1787841937.705148:0:15018:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1787841937.707915:0:15018:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1787841937.707928:0:15018:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787841937.707935:0:15018:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787841937.707937:0:15018:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1787841937.707941:0:15018:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787841937.707944:0:15018:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:2.0:1787841937.707945:0:15018:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787841937.707947:0:15018:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787841937.707948:0:15018:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787841937.707950:0:15018:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787841937.707952:0:15018:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787841937.707954:0:15018:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787841937.707957:0:15018:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787841937.707966:0:15018:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787841937.707970:0:15018:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787841937.707972:0:15018:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787841937.707974:0:15018:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787841937.707977:0:15018:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787841937.707978:0:15018:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787841937.707980:0:15018:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787841937.707983:0:15018:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787841937.707984:0:15018:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787841937.707987:0:15018:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1787841937.708056:0:15018:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787841937.708060:0:15018:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787841937.708062:0:15018:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787841937.708065:0:15018:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:1.0:1787841937.708327:0:15004:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1787841937.708363:0:15004:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787841937.708379:0:15004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc6105e00/0xe3dac0c99afff3ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99afff3f5 expref: -99 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841937.708390:0:15004:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff92cbc6105e00/0xe3dac0c99afff3ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99afff3f5 expref: -99 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787841937.708398:0:15004:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92cbf71ac000 from 1 10000000:01000000:1.0:1787841937.708401:0:15004:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787841937.708437:0:15004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cc00d9d800/0xe3dac0c99afff40a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841937.708445:0:15004:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff92cc00d9d800/0xe3dac0c99afff40a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841937.708456:0:15004:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff92cc00d9d800/0xe3dac0c99afff40a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841937.708480:0:15004:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e2e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:15004:1874687715015808:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787841937.708554:0:15004:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841937.708599:0:15004:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbf0518cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787841937.712759:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715015808 00000100:00100000:2.0:1787841937.712776:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715015808 00000100:00100000:2.0:1787841937.712844:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787841937.712855:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cc01d21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+14:15004:x1874687715015808:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787841937.712875:0:14317:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841937.712894:0:14317:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92cbc6104400/0xe3dac0c99afff411 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe3dac0c99afff40a expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841937.712924:0:14317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92cbc6104400/0xe3dac0c99afff411 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe3dac0c99afff40a expref: 15 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841937.712937:0:14317:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92cbc6104400/0xe3dac0c99afff411 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe3dac0c99afff40a expref: 15 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841937.712947:0:14317:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc6104400, rc 0) 00000100:00100000:2.0:1787841937.716512:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cc01d21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+15:15004:x1874687715015808:12345-0@lo:101:mount.lustre.0 Request processed in 3649us (7948us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841937.716527:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787841937.716849:0:15004:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e2e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:15004:1874687715015808:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787841937.716875:0:15004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff92cc00d9d800/0xe3dac0c99afff40a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99afff411 expref: -99 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841937.716888:0:15004:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff92cc00d9d800/0xe3dac0c99afff40a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe3dac0c99afff411 expref: -99 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787841937.718812:0:15004:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1787841937.719795:0:15004:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787841937.721622:0:15004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1787841937.721724:0:15004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1787841937.721849:0:15004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1787841937.721870:0:15004:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1787841937.722554:0:15004:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac26dd2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:15004:1874687715015936:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787841937.722679:0:15004:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841937.722766:0:15004:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc2e59300 going to sleep for 11 seconds 00000100:00100000:3.0:1787841937.722824:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715015936 00000100:00100000:3.0:1787841937.722841:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715015936 00000100:00100000:3.0:1787841937.722905:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787841937.722915:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cc01d23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+15:15004:x1874687715015936:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787841937.723257:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cc01d23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+15:15004:x1874687715015936:12345-0@lo:501:mount.lustre.0 Request processed in 342us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841937.723266:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787841937.727089:0:15004:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac26dd2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:15004:1874687715015936:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787841937.727155:0:15004:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac26dd2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:15004:1874687715016064:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787841937.727266:0:15004:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841937.727320:0:15004:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc2e59300 going to sleep for 11 seconds 00000100:00100000:3.0:1787841937.727442:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715016064 00000100:00100000:3.0:1787841937.727449:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715016064 00000100:00100000:3.0:1787841937.727510:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787841937.727519:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cc01d21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+15:15004:x1874687715016064:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787841937.727774:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cc01d21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+15:15004:x1874687715016064:12345-0@lo:503:mount.lustre.0 Request processed in 255us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841937.727782:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787841937.727926:0:15004:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac26dd2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:15004:1874687715016064:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787841937.728695:0:15004:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787841937.728826:0:15004:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e2fc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:15004:1874687715016192:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787841937.728879:0:15004:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841937.728912:0:15004:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbf0518cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787841937.729500:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715016192 00000100:00100000:0.0:1787841937.729507:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715016192 00000100:00100000:0.0:1787841937.729563:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787841937.729573:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cc01d20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+15:15004:x1874687715016192:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787841937.729884:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cc01d20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+15:15004:x1874687715016192:12345-0@lo:502:mount.lustre.0 Request processed in 312us (1003us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841937.729892:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787841937.730016:0:15004:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e2fc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:15004:1874687715016192:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787841937.730306:0:15004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1787841937.730380:0:15004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1787841937.730428:0:15004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1787841937.730460:0:15004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1787841937.730485:0:15004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1787841937.730524:0:15004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1787841937.730570:0:15004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1787841937.730600:0:15004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1787841937.730633:0:15004:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac30903c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:15004:1874687715016320:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787841937.730730:0:15004:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841937.730762:0:15004:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc8ddb6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787841937.730973:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715016320 00000100:00100000:0.0:1787841937.730980:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715016320 00000100:00100000:0.0:1787841937.731028:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787841937.731037:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cc01d23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+15:15004:x1874687715016320:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787841937.731231:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cc01d23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+15:15004:x1874687715016320:12345-0@lo:502:mount.lustre.0 Request processed in 195us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841937.731239:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787841937.731911:0:15004:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac30903c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:15004:1874687715016320:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787841937.736214:0:15004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1787841937.736238:0:15004:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1787841937.737766:0:15022:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787841937.737795:0:15022:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787841937.737798:0:15022:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787841937.737805:0:15022:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff92cbf71ac000 00000020:00000080:3.0:1787841937.737807:0:15022:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787841937.737815:0:15022:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787841937.737818:0:15022:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787841937.737819:0:15022:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787841937.737822:0:15022:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787841937.737824:0:15022:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787841937.737826:0:15022:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787841937.737829:0:15022:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff92cbf71ac000 00000020:00000080:3.0:1787841937.737832:0:15022:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787841937.737888:0:15022:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787841937.737892:0:15022:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787841937.737894:0:15022:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787841937.737897:0:15022:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787841937.737909:0:15022:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787841937.737911:0:15022:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787841937.737916:0:15022:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff92cbf71ac000 00000020:00000080:3.0:1787841937.737918:0:15022:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787841937.737957:0:15022:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787841937.737960:0:15022:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787841937.737962:0:15022:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787841937.737966:0:15022:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:0.0:1787841937.748328:0:15004:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1787841937.748391:0:15004:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787841937.748414:0:15004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cc00d9d800/0xe3dac0c99afff40a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99afff411 expref: -99 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841937.748429:0:15004:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff92cc00d9d800/0xe3dac0c99afff40a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99afff411 expref: -99 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787841937.748521:0:15004:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787841937.748525:0:15004:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff92cbf71ac000 10000000:01000000:0.0:1787841937.748528:0:15004:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff92cbf71ac000 10000000:01000000:0.0:1787841937.748533:0:15004:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787841937.748538:0:15004:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff92cbf71ac000 from 1 10000000:01000000:0.0:1787841937.748541:0:15004:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787841937.748580:0:15004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbffa3a400/0xe3dac0c99afff418 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841937.748589:0:15004:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff92cbffa3a400/0xe3dac0c99afff418 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841937.748601:0:15004:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff92cbffa3a400/0xe3dac0c99afff418 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841937.748626:0:15004:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac26ded00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:15004:1874687715016448:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787841937.748737:0:15004:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841937.748777:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715016448 00000100:00100000:0.0:1787841937.748784:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715016448 00000100:00100000:0.0:1787841937.748826:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787841937.748834:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cc01d20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+15:15004:x1874687715016448:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787841937.748846:0:14316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841937.748857:0:14316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92cbffa3a800/0xe3dac0c99afff41f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe3dac0c99afff418 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841937.748880:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92cbffa3a800/0xe3dac0c99afff41f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe3dac0c99afff418 expref: 16 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841937.748900:0:14316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92cbffa3a800/0xe3dac0c99afff41f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe3dac0c99afff418 expref: 16 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841937.748908:0:14316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbffa3a800, rc 0) 00000100:00100000:0.0:1787841937.748939:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cc01d20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+16:15004:x1874687715016448:12345-0@lo:101:mount.lustre.0 Request processed in 106us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841937.748946:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787841937.748989:0:15004:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc2e59900 going to sleep for 11 seconds 00000100:00100000:0.0:1787841937.749009:0:15004:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac26ded00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:15004:1874687715016448:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787841937.749022:0:15004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff92cbffa3a400/0xe3dac0c99afff418 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99afff41f expref: -99 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841937.749031:0:15004:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff92cbffa3a400/0xe3dac0c99afff418 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xe3dac0c99afff41f expref: -99 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787841937.749594:0:15004:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:0.0:1787841937.749924:0:15004:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787841937.750184:0:15004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1787841937.750231:0:15004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1787841937.750268:0:15004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1787841937.750320:0:15004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1787841937.750358:0:15004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1787841937.750406:0:15004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1787841937.750441:0:15004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1787841937.750471:0:15004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1787841937.750511:0:15004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1787841937.750542:0:15004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1787841937.750575:0:15004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1787841937.750641:0:15004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1787841937.750695:0:15004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1787841937.750763:0:15004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1787841937.750831:0:15004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1787841937.750870:0:15004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1787841937.750906:0:15004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1787841937.750955:0:15004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1787841937.750991:0:15004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1787841937.751025:0:15004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1787841937.751067:0:15004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1787841937.751101:0:15004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1787841937.751130:0:15004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1787841937.751173:0:15004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1787841937.751208:0:15004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:0.0:1787841937.751239:0:15004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:0.0:1787841937.751287:0:15004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1787841937.751323:0:15004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1787841937.751385:0:15004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1787841937.751391:0:15004:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:0.0:1787841937.751479:0:15004:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac26ded00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:15004:1874687715016576:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787841937.751544:0:15004:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841937.751578:0:15004:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc2e59900 going to sleep for 11 seconds 00000100:00100000:3.0:1787841937.752808:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715016576 00000100:00100000:3.0:1787841937.752818:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715016576 00000100:00100000:3.0:1787841937.752871:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787841937.752881:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cc01d20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+16:15004:x1874687715016576:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787841937.753150:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cc01d20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+16:15004:x1874687715016576:12345-0@lo:501:mount.lustre.0 Request processed in 269us (1605us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841937.753159:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787841937.759601:0:15004:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac26ded00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:15004:1874687715016576:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787841937.761481:0:15004:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac26ded00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:15004:1874687715016704:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787841937.761557:0:15004:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841937.761600:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715016704 00000100:00100000:0.0:1787841937.761607:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715016704 00000100:00100000:0.0:1787841937.761675:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787841937.761684:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cc01d21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+16:15004:x1874687715016704:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787841937.761896:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cc01d21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+16:15004:x1874687715016704:12345-0@lo:503:mount.lustre.0 Request processed in 212us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841937.761904:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787841937.761955:0:15004:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc2e59900 going to sleep for 11 seconds 00000100:00100000:0.0:1787841937.761974:0:15004:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac26ded00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:15004:1874687715016704:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787841937.764055:0:15004:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787841937.764158:0:15004:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac26ded00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:15004:1874687715016832:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787841937.764231:0:15004:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841937.764621:0:15004:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc2e59900 going to sleep for 11 seconds 00000100:00100000:3.0:1787841937.769264:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715016832 00000100:00100000:3.0:1787841937.769277:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715016832 00000100:00100000:3.0:1787841937.772219:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787841937.772240:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cc01d20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+16:15004:x1874687715016832:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787841937.772596:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cc01d20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+16:15004:x1874687715016832:12345-0@lo:502:mount.lustre.0 Request processed in 364us (8365us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841937.772605:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787841937.772744:0:15004:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac26ded00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:15004:1874687715016832:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787841937.773043:0:15004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1787841937.773112:0:15004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1787841937.773145:0:15004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1787841937.773191:0:15004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1787841937.773225:0:15004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1787841937.773271:0:15004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1787841937.773309:0:15004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1787841937.773742:0:15004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1787841937.773801:0:15004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1787841937.773838:0:15004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1787841937.773868:0:15004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1787841937.773913:0:15004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1787841937.773947:0:15004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1787841937.773981:0:15004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1787841937.774060:0:15004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1787841937.774102:0:15004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1787841937.774146:0:15004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1787841937.774197:0:15004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1787841937.774244:0:15004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1787841937.774278:0:15004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1787841937.774329:0:15004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1787841937.776095:0:15004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1787841937.776147:0:15004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1787841937.776453:0:15004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1787841937.776501:0:15004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1787841937.776558:0:15004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1787841937.776614:0:15004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1787841937.776670:0:15004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1787841937.776859:0:15004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1787841937.776923:0:15004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1787841937.776991:0:15004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1787841937.777035:0:15004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1787841937.777081:0:15004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1787841937.777141:0:15004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1787841937.777183:0:15004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1787841937.778126:0:15004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1787841937.778172:0:15004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1787841937.778210:0:15004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1787841937.778279:0:15004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1787841937.778320:0:15004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1787841937.778389:0:15004:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac26ded00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:15004:1874687715016960:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787841937.778892:0:15004:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841937.779018:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715016960 00000100:00100000:3.0:1787841937.779028:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715016960 00000100:00100000:3.0:1787841937.779083:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787841937.779092:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cc01d21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+16:15004:x1874687715016960:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787841937.779340:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cc01d21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+16:15004:x1874687715016960:12345-0@lo:502:mount.lustre.0 Request processed in 248us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841937.779370:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787841937.779669:0:15004:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc2e59900 going to sleep for 11 seconds 00000100:00100000:0.0:1787841937.779693:0:15004:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac26ded00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:15004:1874687715016960:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787841937.779913:0:15004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1787841937.779925:0:15004:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1787841937.781007:0:15027:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1787841937.781023:0:15027:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff92cbf4268000) 00000020:00000080:3.0:1787841937.781045:0:15027:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1787841937.781113:0:15027:0:(tgt_mount.c:153:server_get_mount()) get mount ffff92cbf71ac000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787841937.781117:0:15027:0:(tgt_mount.c:187:server_put_mount()) put mount ffff92cbf71ac000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787841937.781120:0:15027:0:(obd_mount.c:710:lustre_put_lsi()) put ffff92cbf71ac000 3 00010000:00080000:3.0:1787841937.781145:0:15027:0:(ldlm_lib.c:102:import_set_conn()) imp ffff92cbff5ff000@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.101@tcp at head 00010000:00010000:3.0:1787841937.791675:0:15027:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:3.0:1787841937.792063:0:15027:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1787841937.792107:0:15027:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787841937.792120:0:15027:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xe3dac0c99afff42d 00000100:00080000:3.0:1787841937.792132:0:15027:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787841937.792138:0:15027:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff92cbff5ff000 using connection 192.168.201.101@tcp/0@lo 00000100:00100000:3.0:1787841937.792174:0:15027:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92cac30903c0 x1874687715017088/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787841937.792202:0:15027:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787841937.792253:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787841937.792259:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787841937.792263:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787841937.792266:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787841937.792326:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e2d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874687715017216:0@lo:400:kworker.0 00000100:00100000:1.0:1787841937.792405:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841937.794604:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac30903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3297:1874687715017088:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787841937.794693:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841937.794861:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715017216 00000100:00100000:3.0:1787841937.794870:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715017216 00000100:00100000:3.0:1787841937.794913:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715017088 00000100:00100000:3.0:1787841937.794915:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715017088 00000100:00100000:3.0:1787841937.794928:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787841937.794939:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874687715017216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787841937.795000:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874687715017216:12345-0@lo:400:kworker.0 Request processed in 63us (2594us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841937.795008:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787841937.795026:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787841937.795038:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff3d0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3297:x1874687715017088:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1787841937.795060:0:14324:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 477 last 0 00000020:00000080:3.0:1787841937.795097:0:14324:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xe3dac0c99afff434 00000004:00100000:3.0:1787841937.795111:0:14324:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787841937.795145:0:14324:0:(import.c:65:import_set_state_nolock()) ffff92cbf6ec4000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787841937.795185:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff3d0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1874687715017088:12345-0@lo:38:llog_process_th.0 Request processed in 147us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841937.795192:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787841937.795239:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff92cbf6e2d680 x1874687715017216/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787841953 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787841937.795255:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e2d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874687715017216:0@lo:400:kworker.0 00000040:00080000:3.0:1787841937.795471:0:15027:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00010000:00080000:2.0:1787841937.795866:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff92cac30903c0 x1874687715017088/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787841947 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787841937.795876:0:3297:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787841937.795885:0:3297:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1787841937.795893:0:3297:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787841937.795898:0:3297:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787841937.795901:0:3297:0:(import.c:65:import_set_state_nolock()) ffff92cbff5ff000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787841937.795907:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac30903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3297:1874687715017088:0@lo:38:llog_process_th.0 00000020:01000000:2.0:1787841937.796814:0:15004:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1787841937.796858:0:15004:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787841937.796884:0:15004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbffa3a400/0xe3dac0c99afff418 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99afff41f expref: -99 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841937.796897:0:15004:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff92cbffa3a400/0xe3dac0c99afff418 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99afff41f expref: -99 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787841937.796949:0:15004:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787841937.796951:0:15004:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787841937.796957:0:15004:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787841937.796959:0:15004:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787841937.796960:0:15004:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787841937.796961:0:15004:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787841937.796963:0:15004:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787841937.796965:0:15004:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787841937.796967:0:15004:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787841937.796970:0:15004:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1787841937.796973:0:15004:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787841937.796975:0:15004:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787841937.796976:0:15004:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787841937.796977:0:15004:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787841937.796978:0:15004:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787841937.796979:0:15004:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787841937.796980:0:15004:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787841937.796981:0:15004:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787841937.796982:0:15004:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787841937.797006:0:15004:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787841937.797029:0:15004:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff3d0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:15004:1874687715017344:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787841937.797102:0:15004:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841937.797137:0:15004:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc82edc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787841937.797353:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715017344 00000100:00100000:3.0:1787841937.797371:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715017344 00000100:00100000:3.0:1787841937.797646:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787841937.797667:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cc01d22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+16:15004:x1874687715017344:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787841937.797723:0:14316:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787841937.797738:0:14316:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787841937.829351:0:14316:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787841937.829378:0:14316:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1787841937.829562:0:14338:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787841937.829568:0:14338:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787841937.829592:0:14338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff92cbc6104a00/0xe3dac0c99afff43b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841937.829611:0:14338:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92cbffa3ae00/0xe3dac0c99afff3a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe3dac0c99afff3a1 expref: 16 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841937.829621:0:14338:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff92cbc6104a00/0xe3dac0c99afff43b lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841937.829674:0:14338:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92cbffa3ae00/0xe3dac0c99afff3a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe3dac0c99afff3a1 expref: 16 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841937.829688:0:14338:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92cbffa3ae00/0xe3dac0c99afff3a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe3dac0c99afff3a1 expref: 16 pid: 14316 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841937.829741:0:14338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff3d3840 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14338:1874687715017472:0@lo:104: 00000100:00100000:2.0:1787841937.829810:0:14338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841937.829859:0:14338:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc52623c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787841937.829987:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715017472 00000100:00100000:0.0:1787841937.830000:0:14306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715017472 00000100:00100000:0.0:1787841937.830057:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787841937.830067:0:14306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff3d12c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+3:14338:x1874687715017472:12345-0@lo:104: 00010000:00010000:0.0:1787841937.830079:0:14306:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.101@tcp lock: ffff92cbc6105000/0xe3dac0c99afff3a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe3dac0c99afff3a8 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841937.830135:0:14306:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787841937.830141:0:14306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff3d12c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+3:14338:x1874687715017472:12345-0@lo:104: Request processed in 77us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841937.830149:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1787841937.830172:0:14311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787841937.830178:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.101@tcp lock: ffff92cbc6105000/0xe3dac0c99afff3a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe3dac0c99afff3a8 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841937.830185:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6105000 already unused, calling callback (ffffffffc1d9fc20) 10000000:00010000:0.0:1787841937.830189:0:14311:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.101@tcp lock: ffff92cbc6105000/0xe3dac0c99afff3a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe3dac0c99afff3a8 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841937.830198:0:14311:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.101@tcp lock: ffff92cbc6105000/0xe3dac0c99afff3a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe3dac0c99afff3a8 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787841937.830206:0:14311:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.101@tcp lock: ffff92cbc6105000/0xe3dac0c99afff3a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe3dac0c99afff3a8 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787841937.830211:0:14311:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787841937.830242:0:14311:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.101@tcp lock: ffff92cbc6105000/0xe3dac0c99afff3a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99afff3a8 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841937.830249:0:14311:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787841937.830270:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.101@tcp lock: ffff92cbc6105000/0xe3dac0c99afff3a1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99afff3a8 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841937.830285:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.101@tcp lock: ffff92cbc6105000/0xe3dac0c99afff3a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99afff3a8 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841937.830301:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841937.830303:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841937.830305:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787841937.830319:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac26ded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:3299:1874687715017600:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787841937.830351:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841937.830409:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715017600 00000100:00100000:0.0:1787841937.830413:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715017600 00010000:00010000:0.0:1787841937.830606:0:14308:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92cbffa3ae00/0xe3dac0c99afff3a8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe3dac0c99afff3a1 expref: 17 pid: 14316 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841937.830633:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787841937.830642:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac26dda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+17:3299:x1874687715017600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787841937.830662:0:14308:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787841937.830668:0:14308:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92cbffa3ae00/0xe3dac0c99afff3a8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe3dac0c99afff3a1 expref: 17 pid: 14316 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841937.830678:0:14308:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92cbffa3ae00/0xe3dac0c99afff3a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe3dac0c99afff3a1 expref: 17 pid: 14316 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841937.830722:0:14308:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff92cbc6104a00/0xe3dac0c99afff43b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841937.830731:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92cbc6104a00/0xe3dac0c99afff43b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787841937.830745:0:14308:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001652303s 00010000:00010000:0.0:1787841937.830756:0:14308:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92cbc6104a00/0xe3dac0c99afff43b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841937.830763:0:14308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92cbc6104a00/0xe3dac0c99afff43b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841937.830770:0:14308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff92cbc6104a00/0xe3dac0c99afff43b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841937.830776:0:14308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff92cbc6104a00/0xe3dac0c99afff43b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841937.830782:0:14308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6104a00 already unused, calling callback (ffffffffc17a4500) 00010000:00010000:0.0:1787841937.830786:0:14308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff92cbc6104a00/0xe3dac0c99afff43b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841937.830794:0:14308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff92cbc6104a00/0xe3dac0c99afff43b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841937.830804:0:14308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff92cbc6104a00/0xe3dac0c99afff43b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841937.830813:0:14308:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787841937.830849:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac26dda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+17:3299:x1874687715017600:12345-0@lo:103:ldlm_bl.0 Request processed in 209us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841937.830857:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787841937.830898:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac26ded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:3299:1874687715017600:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787841937.830925:0:14338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92cbffa3ae00/0xe3dac0c99afff3a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe3dac0c99afff3a1 expref: 16 pid: 14316 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841937.830936:0:14338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff3d3840 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14338:1874687715017472:0@lo:104: 00010000:00010000:0.0:1787841937.830956:0:14338:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff92cbc6104a00/0xe3dac0c99afff43b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841937.830965:0:14338:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff92cbc6104a00/0xe3dac0c99afff43b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841937.830971:0:14338:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff92cbc6104a00/0xe3dac0c99afff43b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841937.830978:0:14338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92cbc6104a00/0xe3dac0c99afff43b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841937.840248:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cc01d22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+15:15004:x1874687715017344:12345-0@lo:253:mount.lustre.0 Request processed in 42583us (43135us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841937.840267:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787841937.840395:0:15004:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff3d0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:15004:1874687715017344:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787841937.840413:0:15004:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787841937.840416:0:15004:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787841937.840418:0:15004:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787841937.840420:0:15004:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787841937.840421:0:15004:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787841937.840423:0:15004:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787841937.840424:0:15004:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787841937.840426:0:15004:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787841937.840438:0:15004:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787841937.840439:0:15004:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787841937.840455:0:15004:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787841937.849219:0:15004:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1787841937.849401:0:15004:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787841937.849949:0:15004:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1787841937.850098:0:15004:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787841937.850250:0:15004:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1787841937.851045:0:15004:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1787841937.852038:0:15004:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1787841937.938136:0:15004:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1787841937.938147:0:15004:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1787841937.938182:0:15004:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787841937.938243:0:15004:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.101@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787841937.938259:0:15004:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1787841937.938294:0:15004:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1787841938.052383:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841939.073911:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787841939.457578:0:14319:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787841939.457587:0:14319:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff92cac3549800 from 7 10000000:01000000:3.0:1787841939.457592:0:14319:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787841939.457656:0:14319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc149d600/0xe3dac0c99afff442 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841939.457685:0:14319:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff92cbc149d600/0xe3dac0c99afff442 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841939.457735:0:14319:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff92cbc149d600/0xe3dac0c99afff442 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841939.457762:0:14319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac3090b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:14319:1874687715017728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787841939.457837:0:14319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841939.457932:0:14319:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc8eda480 going to sleep for 11 seconds 00000100:00100000:1.0:1787841939.460852:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715017728 00000100:00100000:1.0:1787841939.460869:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715017728 00000100:00100000:0.0:1787841939.461231:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787841939.461244:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cc01d22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+15:14319:x1874687715017728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787841939.461262:0:14317:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841939.461286:0:14317:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92cbffa3aa00/0xe3dac0c99afff449 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe3dac0c99afff442 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841939.461326:0:14317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92cbffa3aa00/0xe3dac0c99afff449 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe3dac0c99afff442 expref: 16 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841939.461337:0:14317:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92cbffa3aa00/0xe3dac0c99afff449 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe3dac0c99afff442 expref: 16 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841939.461346:0:14317:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbffa3aa00, rc 0) 00000100:00100000:0.0:1787841939.461454:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cc01d22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+16:14319:x1874687715017728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 212us (3615us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841939.461475:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787841939.461570:0:14319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac3090b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:14319:1874687715017728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787841939.461590:0:14319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff92cbc149d600/0xe3dac0c99afff442 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99afff449 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841939.461599:0:14319:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff92cbc149d600/0xe3dac0c99afff442 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe3dac0c99afff449 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841939.461680:0:14319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e2e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:14319:1874687715017856:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787841939.461769:0:14319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841939.462758:0:14319:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc2e21480 going to sleep for 11 seconds 00000100:00100000:3.0:1787841939.462917:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715017856 00000100:00100000:3.0:1787841939.462924:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715017856 00000100:00100000:3.0:1787841939.462960:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787841939.462969:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe9839850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+16:14319:x1874687715017856:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787841939.462991:0:14315:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787841939.463010:0:14315:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787841939.463014:0:14315:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1787841939.463215:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe9839850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+16:14319:x1874687715017856:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 247us (1445us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841939.463223:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787841939.463665:0:14319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e2e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:14319:1874687715017856:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787841939.463876:0:14319:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787841939.463887:0:14319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc149d600/0xe3dac0c99afff442 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99afff449 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841939.463908:0:14319:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff92cbc149d600/0xe3dac0c99afff442 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99afff449 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841940.107532:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841941.122470:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841942.145846:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841943.171309:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787841943.302726:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787841943.302734:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787841943.302737:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787841943.302743:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787841943.302803:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e2c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:3300:1874687715017984:0@lo:400:kworker.0 00000100:00100000:1.0:1787841943.302884:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841943.302939:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787841943.302945:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e2cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874687715018112:0@lo:400:kworker.0 00000100:00100000:1.0:1787841943.302973:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841943.303008:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e2d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1874687715018240:0@lo:400:kworker.0 00000100:00100000:1.0:1787841943.303039:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841943.303073:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715017984 00000100:00100000:1.0:1787841943.303081:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715017984 00000100:00100000:1.0:1787841943.303123:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787841943.303133:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe9838850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+16:3300:x1874687715017984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841943.303184:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe9838850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+16:3300:x1874687715017984:12345-0@lo:400:kworker.0 Request processed in 52us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841943.303192:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787841943.303226:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715018112 00000100:00100000:1.0:1787841943.303239:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715018112 00000100:00100000:1.0:1787841943.303267:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715018240 00000100:00100000:1.0:1787841943.303270:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715018240 00000100:00100000:1.0:1787841943.303296:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787841943.303303:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e2fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874687715018112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841943.303337:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e2fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874687715018112:12345-0@lo:400:kworker.0 Request processed in 35us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841943.303344:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787841943.303356:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787841943.303362:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e2e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1874687715018240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841943.303394:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e2e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1874687715018240:12345-0@lo:400:kworker.0 Request processed in 32us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841943.303400:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1787841943.303442:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92cbf6e2cf00 x1874687715018112/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787841959 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787841943.303457:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e2cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874687715018112:0@lo:400:kworker.0 00000100:00100000:1.0:1787841943.303467:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e2c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:3300:1874687715017984:0@lo:400:kworker.0 00000100:00080000:1.0:1787841943.303506:0:14318:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787841943.303524:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92cbf6e2d680 x1874687715018240/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787841959 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787841943.303534:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e2d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1874687715018240:0@lo:400:kworker.0 00000040:00080000:2.0:1787841943.682362:0:14354:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787841944.195629:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787841944.975284:0:15372:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg101-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787841945.216931:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841946.240849:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787841947.009218:0:3297:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787841931/real 1787841931] req@ffff92cbff3d03c0 x1874687715013760/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787841946 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787841947.009260:0:3297:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff92cbff3d03c0 x1874687715013760/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787841946 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787841947.009290:0:3297:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787841931/real 1787841931] req@ffff92cbff3d2580 x1874687715013888/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787841946 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787841947.009305:0:3297:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff92cbff3d2580 x1874687715013888/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787841946 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787841947.009327:0:3297:0:(import.c:65:import_set_state_nolock()) ffff92cbc7985000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787841947.009355:0:3297:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787841947.009360:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff3d03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1874687715013760:0@lo:8:kworker.0 00000100:00080000:3.0:1787841947.009367:0:3297:0:(import.c:65:import_set_state_nolock()) ffff92cbff853000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787841947.009373:0:3297:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787841947.009376:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff3d2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1874687715013888:0@lo:8:kworker.0 00000100:00080000:2.0:1787841947.009568:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787841947.009574:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787841947.009577:0:36:0:(import.c:65:import_set_state_nolock()) ffff92cbc7985000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787841947.009583:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 471 00000100:00080000:2.0:1787841947.009597:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787841947.009605:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff92cbc7985000 using connection 192.168.201.101@tcp/0@lo 00000100:00100000:2.0:1787841947.009630:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92cbff3d0b40 x1874687715018496/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787841947.009642:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787841947.009645:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787841947.009646:0:36:0:(import.c:65:import_set_state_nolock()) ffff92cbff853000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787841947.009650:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 471 00000100:00080000:2.0:1787841947.009652:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787841947.009655:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff92cbff853000 using connection 192.168.201.101@tcp/0@lo 00000100:00100000:2.0:1787841947.009665:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92cbff3d1680 x1874687715018624/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787841947.009780:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff3d2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:3299:1874687715018368:0@lo:400:kworker.0 00000100:00100000:3.0:1787841947.009872:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841947.009949:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff3d0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1874687715018496:0@lo:8:kworker.0 00000100:00100000:3.0:1787841947.009980:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841947.009998:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff3d1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1874687715018624:0@lo:8:kworker.0 00000100:00100000:3.0:1787841947.010019:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841947.010060:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715018496 00000100:00100000:3.0:1787841947.010068:0:15006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715018496 00000100:00100000:3.0:1787841947.010097:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715018624 00000100:00100000:3.0:1787841947.010100:0:15006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715018624 00000100:00100000:3.0:1787841947.010115:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787841947.010122:0:15006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac3090000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3297:x1874687715018496:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1787841947.010162:0:15006:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 487 last 0 00000020:00000080:3.0:1787841947.010212:0:15006:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe3dac0c99afff450 00002000:00100000:3.0:1787841947.010229:0:15006:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff92cbf6ec2800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211395f ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1787841947.010233:0:15006:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1787841947.010237:0:15006:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787841947.010865:0:15006:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787841947.010901:0:15006:0:(import.c:65:import_set_state_nolock()) ffff92cbf6ec6000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787841947.010978:0:15006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac3090000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3297:x1874687715018496:12345-0@lo:8:kworker.0 Request processed in 854us (996us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841947.010988:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787841947.011019:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787841947.011024:0:15006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac3093480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3297:x1874687715018624:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1787841947.011040:0:15006:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787841947.011068:0:15006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac3093480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3297:x1874687715018624:12345-0@lo:8:kworker.0 Request processed in 42us (1048us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787841947.011074:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787841947.011126:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92cbff3d0b40 x1874687715018496/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787841967 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787841947.011139:0:3297:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787841947.011149:0:3297:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1787841947.011158:0:3297:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787841947.011164:0:3297:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1787841947.011167:0:3297:0:(import.c:65:import_set_state_nolock()) ffff92cbc7985000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787841947.011187:0:3297:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787841947.011194:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff3d0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1874687715018496:0@lo:8:kworker.0 00000100:00080000:3.0:1787841947.011207:0:3297:0:(import.c:65:import_set_state_nolock()) ffff92cbff853000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787841947.011211:0:3297:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787841947.011224:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff3d1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1874687715018624:0@lo:8:kworker.0 00000004:00080000:3.0:1787841947.011258:0:14343:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787841947.011554:0:14343:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 487009854812ns, next at 0ns, rc = 0 00000100:00100000:2.0:1787841947.011682:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715018368 00000100:00100000:2.0:1787841947.011689:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715018368 00000100:00100000:2.0:1787841947.011760:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787841947.011769:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe983bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+16:3299:x1874687715018368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841947.011834:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe983bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+16:3299:x1874687715018368:12345-0@lo:400:kworker.0 Request processed in 66us (1962us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841947.011842:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787841947.011896:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff3d2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:3299:1874687715018368:0@lo:400:kworker.0 00000100:00100000:1.0:1787841947.012137:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff3d0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874687715018752:0@lo:400:kworker.0 00000100:00100000:1.0:1787841947.012183:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841947.012220:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787841947.012227:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff3d1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1874687715018880:0@lo:400:kworker.0 00000100:00100000:1.0:1787841947.012261:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841947.012299:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715018752 00000100:00100000:1.0:1787841947.012303:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715018752 00000100:00100000:1.0:1787841947.012333:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715018880 00000100:00100000:1.0:1787841947.012336:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715018880 00000100:00100000:1.0:1787841947.012364:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787841947.012370:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e2d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874687715018752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841947.012411:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e2d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874687715018752:12345-0@lo:400:kworker.0 Request processed in 41us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841947.012418:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787841947.012432:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787841947.012438:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e2c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874687715018880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841947.012465:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e2c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874687715018880:12345-0@lo:400:kworker.0 Request processed in 28us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841947.012470:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1787841947.012489:0:14318:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787841947.012524:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92cbff3d1a40 x1874687715018880/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787841963 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787841947.012535:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff3d1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1874687715018880:0@lo:400:kworker.0 00010000:00080000:1.0:1787841947.012543:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92cbff3d0f00 x1874687715018752/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787841963 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787841947.012549:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff3d0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874687715018752:0@lo:400:kworker.0 00000004:00080000:1.0:1787841947.016843:0:14344:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:1.0:1787841947.016882:0:14344:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e2c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14344:1874687715019136:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1787841947.016986:0:14344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841947.017036:0:14344:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbd14e3e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787841947.017081:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e2cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687715019008:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787841947.017110:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841947.020107:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715019008 00000100:00100000:3.0:1787841947.020122:0:15008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715019008 00000100:00100000:3.0:1787841947.020196:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787841947.020206:0:15008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e2d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3298:x1874687715019008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787841947.020252:0:15008:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1787841947.020344:0:14318:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787841947.020466:0:15008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e2d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3298:x1874687715019008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 260us (3353us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841947.020474:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787841947.020516:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715019136 00000100:00100000:3.0:1787841947.020520:0:15006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715019136 00000100:00100000:3.0:1787841947.020551:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787841947.020558:0:15006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e2cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14344:x1874687715019136:12345-0@lo:5:osp-pre-0-0.0 00010000:00080000:1.0:1787841947.021437:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92cbf6e2cf00 x1874687715019008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841963 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787841947.021465:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e2cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687715019008:0@lo:13:osp-pre-0-0.0 00002000:00080000:3.0:1787841947.026075:0:15006:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1787841947.026089:0:15006:0:(ofd_dev.c:1643:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:3.0:1787841947.026096:0:15006:0:(ofd_dev.c:1494:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00002000:00010000:3.0:1787841947.050548:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787841947.050564:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef056f27/0xe3dac0c99afff457 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.050585:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=487s v=(0 0) 00010000:00010000:3.0:1787841947.050590:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787841947.050597:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ef056f27/0xe3dac0c99afff457 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.050630:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ef056f27/0xe3dac0c99afff457 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.050643:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef056f27/0xe3dac0c99afff457 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.050650:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ef056f27/0xe3dac0c99afff457 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.050681:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787841947.050732:0:14311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787841947.050739:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ef056f27/0xe3dac0c99afff457 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.050747:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc149c800 already unused, calling callback (ffffffffc17a4500) 00010000:00010000:3.0:1787841947.050753:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef056f27/0xe3dac0c99afff457 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.050763:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef056f27/0xe3dac0c99afff457 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.050784:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ef056f27/0xe3dac0c99afff457 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.050792:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ef056f27/0xe3dac0c99afff457 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.050822:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841947.050823:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841947.050826:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787841947.051372:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787841947.051379:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c95fddcb/0xe3dac0c99afff45e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.051389:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=487s v=(0 0) 00010000:00010000:3.0:1787841947.051392:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787841947.051397:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c95fddcb/0xe3dac0c99afff45e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.051408:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c95fddcb/0xe3dac0c99afff45e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.051417:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c95fddcb/0xe3dac0c99afff45e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.051423:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c95fddcb/0xe3dac0c99afff45e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.051442:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787841947.051452:0:14310:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787841947.051457:0:14310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c95fddcb/0xe3dac0c99afff45e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.051477:0:14310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc149de00 already unused, calling callback (ffffffffc17a4500) 00010000:00010000:3.0:1787841947.051481:0:14310:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c95fddcb/0xe3dac0c99afff45e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.051507:0:14310:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c95fddcb/0xe3dac0c99afff45e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.051522:0:14310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c95fddcb/0xe3dac0c99afff45e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.051530:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c95fddcb/0xe3dac0c99afff45e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.051546:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841947.051548:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841947.051550:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787841947.051992:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787841947.051998:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006594b9eb/0xe3dac0c99afff465 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.052008:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=487s v=(0 0) 00010000:00010000:3.0:1787841947.052011:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787841947.052015:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006594b9eb/0xe3dac0c99afff465 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.052026:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006594b9eb/0xe3dac0c99afff465 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.052041:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006594b9eb/0xe3dac0c99afff465 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.052048:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006594b9eb/0xe3dac0c99afff465 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.052062:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787841947.052071:0:14311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787841947.052076:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006594b9eb/0xe3dac0c99afff465 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.052083:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc149ce00 already unused, calling callback (ffffffffc17a4500) 00010000:00010000:3.0:1787841947.052087:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006594b9eb/0xe3dac0c99afff465 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.052094:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006594b9eb/0xe3dac0c99afff465 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.052105:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006594b9eb/0xe3dac0c99afff465 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.052112:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006594b9eb/0xe3dac0c99afff465 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.052126:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841947.052133:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841947.052135:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787841947.065758:0:5860:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:2.0:1787841947.072536:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787841947.072558:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091d01c44/0xe3dac0c99afff46c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.072586:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=487s v=(0 0) 00010000:00010000:2.0:1787841947.072607:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787841947.072618:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000091d01c44/0xe3dac0c99afff46c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.072638:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000091d01c44/0xe3dac0c99afff46c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.072651:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091d01c44/0xe3dac0c99afff46c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.072659:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000091d01c44/0xe3dac0c99afff46c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.072689:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787841947.073369:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787841947.073377:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ac7d004/0xe3dac0c99afff473 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.073388:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=487s v=(0 0) 00010000:00010000:2.0:1787841947.073392:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787841947.073397:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ac7d004/0xe3dac0c99afff473 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.073410:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008ac7d004/0xe3dac0c99afff473 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.073418:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ac7d004/0xe3dac0c99afff473 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.073429:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008ac7d004/0xe3dac0c99afff473 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.073447:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787841947.073473:0:14311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787841947.073482:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000091d01c44/0xe3dac0c99afff46c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.073503:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6104800 already unused, calling callback (ffffffffc17a4500) 00010000:00010000:1.0:1787841947.073508:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000091d01c44/0xe3dac0c99afff46c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.073519:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000091d01c44/0xe3dac0c99afff46c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.073543:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000091d01c44/0xe3dac0c99afff46c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.073551:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000091d01c44/0xe3dac0c99afff46c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.073574:0:14311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787841947.073578:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008ac7d004/0xe3dac0c99afff473 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.073591:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6104a00 already unused, calling callback (ffffffffc17a4500) 00010000:00010000:1.0:1787841947.073594:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008ac7d004/0xe3dac0c99afff473 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.073603:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008ac7d004/0xe3dac0c99afff473 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.073614:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008ac7d004/0xe3dac0c99afff473 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.073622:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ac7d004/0xe3dac0c99afff473 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.073635:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841947.073637:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841947.073640:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787841947.073882:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787841947.073889:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000815cc77/0xe3dac0c99afff47a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.073898:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=487s v=(0 0) 00010000:00010000:2.0:1787841947.073902:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787841947.073905:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000815cc77/0xe3dac0c99afff47a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.073914:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000815cc77/0xe3dac0c99afff47a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.073923:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000815cc77/0xe3dac0c99afff47a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.073930:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000815cc77/0xe3dac0c99afff47a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.073946:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787841947.073971:0:14311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787841947.073976:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000815cc77/0xe3dac0c99afff47a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.073984:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6105000 already unused, calling callback (ffffffffc17a4500) 00010000:00010000:1.0:1787841947.073988:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000815cc77/0xe3dac0c99afff47a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.073996:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000815cc77/0xe3dac0c99afff47a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.074013:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000815cc77/0xe3dac0c99afff47a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.074021:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000815cc77/0xe3dac0c99afff47a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.074034:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841947.074035:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841947.074037:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787841947.074260:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787841947.074265:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000646dd324/0xe3dac0c99afff481 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.074277:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=487s v=(0 0) 00010000:00010000:2.0:1787841947.074281:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787841947.074285:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000646dd324/0xe3dac0c99afff481 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.074294:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000646dd324/0xe3dac0c99afff481 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.074301:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000646dd324/0xe3dac0c99afff481 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.074309:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000646dd324/0xe3dac0c99afff481 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.074329:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787841947.074345:0:14311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787841947.074350:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000646dd324/0xe3dac0c99afff481 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.074359:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6105400 already unused, calling callback (ffffffffc17a4500) 00010000:00010000:1.0:1787841947.074372:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000646dd324/0xe3dac0c99afff481 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.074381:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000646dd324/0xe3dac0c99afff481 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.074392:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000646dd324/0xe3dac0c99afff481 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.074400:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000646dd324/0xe3dac0c99afff481 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.074424:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841947.074426:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841947.074428:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841947.074882:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787841947.076682:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787841947.076845:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000324a6bfe/0xe3dac0c99afff488 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.076867:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=487s v=(0 0) 00010000:00010000:2.0:1787841947.076872:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787841947.076878:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000324a6bfe/0xe3dac0c99afff488 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.076894:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000324a6bfe/0xe3dac0c99afff488 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.076916:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000324a6bfe/0xe3dac0c99afff488 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.076924:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000324a6bfe/0xe3dac0c99afff488 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841947.077050:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787841947.077557:0:14311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787841947.077566:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000324a6bfe/0xe3dac0c99afff488 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.077576:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6104000 already unused, calling callback (ffffffffc17a4500) 00010000:00010000:2.0:1787841947.077581:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000324a6bfe/0xe3dac0c99afff488 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.077590:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000324a6bfe/0xe3dac0c99afff488 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.077612:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000324a6bfe/0xe3dac0c99afff488 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.077620:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000324a6bfe/0xe3dac0c99afff488 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.077644:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841947.077646:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841947.077656:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787841947.079146:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787841947.079161:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7800b92/0xe3dac0c99afff48f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841947.079180:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=487s v=(0 0) 00010000:00010000:0.0:1787841947.079185:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787841947.079191:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7800b92/0xe3dac0c99afff48f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841947.079208:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7800b92/0xe3dac0c99afff48f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841947.079218:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7800b92/0xe3dac0c99afff48f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841947.079226:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d7800b92/0xe3dac0c99afff48f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841947.079293:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787841947.079887:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787841947.079896:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001facac3f/0xe3dac0c99afff496 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841947.079907:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=487s v=(0 0) 00010000:00010000:0.0:1787841947.079916:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787841947.079921:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001facac3f/0xe3dac0c99afff496 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841947.079931:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001facac3f/0xe3dac0c99afff496 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841947.079939:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001facac3f/0xe3dac0c99afff496 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841947.079944:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001facac3f/0xe3dac0c99afff496 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.080176:0:14310:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787841947.080186:0:14310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d7800b92/0xe3dac0c99afff48f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.080194:0:14310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbffa3b200 already unused, calling callback (ffffffffc17a4500) 00010000:00010000:2.0:1787841947.080199:0:14310:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7800b92/0xe3dac0c99afff48f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.080208:0:14310:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7800b92/0xe3dac0c99afff48f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.080226:0:14310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d7800b92/0xe3dac0c99afff48f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.080235:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7800b92/0xe3dac0c99afff48f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.080254:0:14310:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787841947.080258:0:14310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001facac3f/0xe3dac0c99afff496 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.080263:0:14310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbffa3be00 already unused, calling callback (ffffffffc17a4500) 00010000:00010000:2.0:1787841947.080267:0:14310:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001facac3f/0xe3dac0c99afff496 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.080275:0:14310:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001facac3f/0xe3dac0c99afff496 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.080294:0:14310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001facac3f/0xe3dac0c99afff496 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.080302:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841947.080304:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841947.080307:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841947.080425:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787841947.080432:0:15006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001facac3f/0xe3dac0c99afff496 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787841947.083171:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787841947.083189:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000469f73d2/0xe3dac0c99afff49d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841947.083210:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=487s v=(0 0) 00010000:00010000:0.0:1787841947.083215:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787841947.083222:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000469f73d2/0xe3dac0c99afff49d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841947.083238:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000469f73d2/0xe3dac0c99afff49d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841947.083256:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000469f73d2/0xe3dac0c99afff49d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841947.083265:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000469f73d2/0xe3dac0c99afff49d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.083929:0:14311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787841947.083941:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000469f73d2/0xe3dac0c99afff49d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.083951:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbffa3ba00 already unused, calling callback (ffffffffc17a4500) 00010000:00010000:2.0:1787841947.083955:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000469f73d2/0xe3dac0c99afff49d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.083964:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000469f73d2/0xe3dac0c99afff49d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.083987:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000469f73d2/0xe3dac0c99afff49d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841947.084087:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787841947.084094:0:15006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000469f73d2/0xe3dac0c99afff49d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.084442:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787841947.085387:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787841947.085399:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000891689c2/0xe3dac0c99afff4a4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841947.085415:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=487s v=(0 0) 00010000:00010000:0.0:1787841947.085420:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787841947.085427:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000891689c2/0xe3dac0c99afff4a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841947.085443:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000891689c2/0xe3dac0c99afff4a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841947.085453:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000891689c2/0xe3dac0c99afff4a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841947.085471:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000891689c2/0xe3dac0c99afff4a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841947.085501:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787841947.086541:0:14310:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787841947.086553:0:14310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000891689c2/0xe3dac0c99afff4a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.086565:0:14310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbffa3b800 already unused, calling callback (ffffffffc17a4500) 00010000:00010000:2.0:1787841947.086577:0:14310:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000891689c2/0xe3dac0c99afff4a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.086590:0:14310:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000891689c2/0xe3dac0c99afff4a4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.086614:0:14310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000891689c2/0xe3dac0c99afff4a4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.086623:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000891689c2/0xe3dac0c99afff4a4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.086648:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841947.086650:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841947.086652:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841947.086945:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841947.086948:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841947.086950:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787841947.088771:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787841947.088792:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e650786e/0xe3dac0c99afff4ab lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.088821:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=487s v=(0 0) 00010000:00010000:2.0:1787841947.088827:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787841947.088836:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e650786e/0xe3dac0c99afff4ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.088854:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e650786e/0xe3dac0c99afff4ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.088875:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e650786e/0xe3dac0c99afff4ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.088883:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e650786e/0xe3dac0c99afff4ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.088912:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787841947.089338:0:14310:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787841947.089347:0:14310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e650786e/0xe3dac0c99afff4ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.089357:0:14310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbffa3ac00 already unused, calling callback (ffffffffc17a4500) 00010000:00010000:3.0:1787841947.089362:0:14310:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e650786e/0xe3dac0c99afff4ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.089373:0:14310:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e650786e/0xe3dac0c99afff4ab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.089395:0:14310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e650786e/0xe3dac0c99afff4ab lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.089405:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e650786e/0xe3dac0c99afff4ab lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.089434:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841947.089436:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841947.089438:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787841947.090501:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787841947.090512:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b70be7c/0xe3dac0c99afff4b2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841947.090529:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=487s v=(0 0) 00010000:00010000:0.0:1787841947.090533:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787841947.090540:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b70be7c/0xe3dac0c99afff4b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841947.090552:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b70be7c/0xe3dac0c99afff4b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841947.090563:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b70be7c/0xe3dac0c99afff4b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841947.090572:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b70be7c/0xe3dac0c99afff4b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841947.090604:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787841947.090733:0:14311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787841947.090742:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b70be7c/0xe3dac0c99afff4b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.090750:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbffa3a000 already unused, calling callback (ffffffffc17a4500) 00010000:00010000:2.0:1787841947.090755:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b70be7c/0xe3dac0c99afff4b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.090765:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b70be7c/0xe3dac0c99afff4b2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.090782:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b70be7c/0xe3dac0c99afff4b2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.090790:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b70be7c/0xe3dac0c99afff4b2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.090810:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841947.090818:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841947.090820:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787841947.094266:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787841947.094544:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce4b8d06/0xe3dac0c99afff4b9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.094565:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=487s v=(0 0) 00010000:00010000:1.0:1787841947.094571:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787841947.094578:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce4b8d06/0xe3dac0c99afff4b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.094596:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce4b8d06/0xe3dac0c99afff4b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.094607:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce4b8d06/0xe3dac0c99afff4b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.094615:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ce4b8d06/0xe3dac0c99afff4b9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.094643:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787841947.094756:0:14310:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787841947.094767:0:14310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ce4b8d06/0xe3dac0c99afff4b9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.094776:0:14310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cc00d9dc00 already unused, calling callback (ffffffffc17a4500) 00010000:00010000:3.0:1787841947.094790:0:14310:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce4b8d06/0xe3dac0c99afff4b9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.094799:0:14310:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce4b8d06/0xe3dac0c99afff4b9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.094822:0:14310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ce4b8d06/0xe3dac0c99afff4b9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.094830:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce4b8d06/0xe3dac0c99afff4b9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.094853:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841947.094856:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841947.094858:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787841947.095215:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787841947.095221:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022a2dbdf/0xe3dac0c99afff4c0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.095242:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=487s v=(0 0) 00010000:00010000:1.0:1787841947.095245:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787841947.095249:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022a2dbdf/0xe3dac0c99afff4c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.095257:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000022a2dbdf/0xe3dac0c99afff4c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.095265:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022a2dbdf/0xe3dac0c99afff4c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.095272:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000022a2dbdf/0xe3dac0c99afff4c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.095300:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787841947.095361:0:14311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787841947.095367:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000022a2dbdf/0xe3dac0c99afff4c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.095375:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cc00d9c800 already unused, calling callback (ffffffffc17a4500) 00010000:00010000:3.0:1787841947.095379:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000022a2dbdf/0xe3dac0c99afff4c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.095387:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000022a2dbdf/0xe3dac0c99afff4c0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.095399:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000022a2dbdf/0xe3dac0c99afff4c0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.095412:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022a2dbdf/0xe3dac0c99afff4c0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.095425:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841947.095427:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841947.095429:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787841947.095776:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787841947.095783:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000060899752/0xe3dac0c99afff4c7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.095793:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=487s v=(0 0) 00010000:00010000:1.0:1787841947.095796:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787841947.095802:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000060899752/0xe3dac0c99afff4c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.095813:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000060899752/0xe3dac0c99afff4c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.095834:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000060899752/0xe3dac0c99afff4c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.095840:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000060899752/0xe3dac0c99afff4c7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.095861:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787841947.095956:0:14310:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787841947.095962:0:14310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000060899752/0xe3dac0c99afff4c7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.095971:0:14310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cc00d9d000 already unused, calling callback (ffffffffc17a4500) 00010000:00010000:3.0:1787841947.095974:0:14310:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000060899752/0xe3dac0c99afff4c7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.095983:0:14310:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000060899752/0xe3dac0c99afff4c7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.095996:0:14310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000060899752/0xe3dac0c99afff4c7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.096004:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000060899752/0xe3dac0c99afff4c7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.096021:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841947.096023:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841947.096024:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787841947.096265:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787841947.096270:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002c56f20/0xe3dac0c99afff4ce lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.096278:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=487s v=(0 0) 00010000:00010000:1.0:1787841947.096281:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787841947.096285:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000002c56f20/0xe3dac0c99afff4ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.096293:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000002c56f20/0xe3dac0c99afff4ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.096300:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002c56f20/0xe3dac0c99afff4ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.096308:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000002c56f20/0xe3dac0c99afff4ce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.096334:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787841947.096351:0:14311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787841947.096356:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000002c56f20/0xe3dac0c99afff4ce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.096364:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cc00d9c400 already unused, calling callback (ffffffffc17a4500) 00010000:00010000:3.0:1787841947.096367:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000002c56f20/0xe3dac0c99afff4ce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.096375:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000002c56f20/0xe3dac0c99afff4ce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.096386:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000002c56f20/0xe3dac0c99afff4ce lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.096393:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000002c56f20/0xe3dac0c99afff4ce lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.096405:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841947.096407:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841947.096409:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787841947.096776:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787841947.096782:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061415e2f/0xe3dac0c99afff4d5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.096791:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=487s v=(0 0) 00010000:00010000:1.0:1787841947.096794:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787841947.096798:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061415e2f/0xe3dac0c99afff4d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.096806:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061415e2f/0xe3dac0c99afff4d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.096812:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061415e2f/0xe3dac0c99afff4d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.096819:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000061415e2f/0xe3dac0c99afff4d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.096832:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787841947.096929:0:14310:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787841947.096935:0:14310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000061415e2f/0xe3dac0c99afff4d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.096942:0:14310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cc00d9cc00 already unused, calling callback (ffffffffc17a4500) 00010000:00010000:3.0:1787841947.096946:0:14310:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000061415e2f/0xe3dac0c99afff4d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.096965:0:14310:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000061415e2f/0xe3dac0c99afff4d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.096976:0:14310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000061415e2f/0xe3dac0c99afff4d5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.096983:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061415e2f/0xe3dac0c99afff4d5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.096996:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841947.096998:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841947.097000:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787841947.097235:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787841947.097240:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000829602e5/0xe3dac0c99afff4dc lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.097248:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=487s v=(0 0) 00010000:00010000:1.0:1787841947.097254:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787841947.097259:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000829602e5/0xe3dac0c99afff4dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.097268:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000829602e5/0xe3dac0c99afff4dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.097276:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000829602e5/0xe3dac0c99afff4dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.097283:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000829602e5/0xe3dac0c99afff4dc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.099676:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787841947.101335:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787841947.101685:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8f7d18b/0xe3dac0c99afff4e3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.101734:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=487s v=(0 0) 00010000:00010000:1.0:1787841947.101739:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787841947.101747:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f8f7d18b/0xe3dac0c99afff4e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.101774:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f8f7d18b/0xe3dac0c99afff4e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.101786:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8f7d18b/0xe3dac0c99afff4e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.101800:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f8f7d18b/0xe3dac0c99afff4e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.101921:0:14311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787841947.101932:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000829602e5/0xe3dac0c99afff4dc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.101942:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cc00d9ce00 already unused, calling callback (ffffffffc17a4500) 00010000:00010000:3.0:1787841947.101948:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000829602e5/0xe3dac0c99afff4dc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.101959:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000829602e5/0xe3dac0c99afff4dc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.101981:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000829602e5/0xe3dac0c99afff4dc lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.101998:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000829602e5/0xe3dac0c99afff4dc lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.102019:0:14311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787841947.102023:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f8f7d18b/0xe3dac0c99afff4e3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.102029:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cc00d9d400 already unused, calling callback (ffffffffc17a4500) 00010000:00010000:3.0:1787841947.102032:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8f7d18b/0xe3dac0c99afff4e3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.102039:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8f7d18b/0xe3dac0c99afff4e3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.102048:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f8f7d18b/0xe3dac0c99afff4e3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.102055:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841947.102057:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841947.102059:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841947.102222:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787841947.102228:0:15006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f8f7d18b/0xe3dac0c99afff4e3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787841947.103044:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787841947.103053:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055e74843/0xe3dac0c99afff4ea lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.103066:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=487s v=(0 0) 00010000:00010000:1.0:1787841947.103070:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787841947.103076:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055e74843/0xe3dac0c99afff4ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.103118:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000055e74843/0xe3dac0c99afff4ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.103130:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055e74843/0xe3dac0c99afff4ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.103138:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000055e74843/0xe3dac0c99afff4ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.104132:0:14310:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787841947.104143:0:14310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000055e74843/0xe3dac0c99afff4ea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.104155:0:14310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cc00d9da00 already unused, calling callback (ffffffffc17a4500) 00010000:00010000:3.0:1787841947.104166:0:14310:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000055e74843/0xe3dac0c99afff4ea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.104177:0:14310:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000055e74843/0xe3dac0c99afff4ea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.104197:0:14310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000055e74843/0xe3dac0c99afff4ea lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.104207:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841947.104209:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841947.104210:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841947.104301:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787841947.104308:0:15006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000055e74843/0xe3dac0c99afff4ea lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841947.104342:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787841947.111022:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787841947.111045:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069da2345/0xe3dac0c99afff4f1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.111071:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=487s v=(0 0) 00010000:00010000:1.0:1787841947.111077:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787841947.111085:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069da2345/0xe3dac0c99afff4f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.111105:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069da2345/0xe3dac0c99afff4f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.111117:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069da2345/0xe3dac0c99afff4f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.111127:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069da2345/0xe3dac0c99afff4f1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.111157:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787841947.112263:0:14310:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787841947.112275:0:14310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069da2345/0xe3dac0c99afff4f1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.112288:0:14310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cc00d9d600 already unused, calling callback (ffffffffc17a4500) 00010000:00010000:2.0:1787841947.112293:0:14310:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069da2345/0xe3dac0c99afff4f1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.112305:0:14310:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069da2345/0xe3dac0c99afff4f1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.112330:0:14310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069da2345/0xe3dac0c99afff4f1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.112337:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069da2345/0xe3dac0c99afff4f1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.112360:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841947.112362:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841947.112364:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787841947.113164:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787841947.113175:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd9b9e36/0xe3dac0c99afff4f8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.113197:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=487s v=(0 0) 00010000:00010000:1.0:1787841947.113201:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787841947.113208:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd9b9e36/0xe3dac0c99afff4f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.113220:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd9b9e36/0xe3dac0c99afff4f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.113230:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd9b9e36/0xe3dac0c99afff4f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.113238:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cd9b9e36/0xe3dac0c99afff4f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.113260:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787841947.113810:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787841947.113817:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b8c2380/0xe3dac0c99afff4ff lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.113827:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=487s v=(0 0) 00010000:00010000:1.0:1787841947.113830:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787841947.113835:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b8c2380/0xe3dac0c99afff4ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.113845:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b8c2380/0xe3dac0c99afff4ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.113865:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b8c2380/0xe3dac0c99afff4ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.113873:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b8c2380/0xe3dac0c99afff4ff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.113889:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1787841947.114316:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787841947.114322:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000060bffcb6/0xe3dac0c99afff506 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.114330:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=487s v=(0 0) 00010000:00010000:1.0:1787841947.114333:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787841947.114337:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000060bffcb6/0xe3dac0c99afff506 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.114346:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000060bffcb6/0xe3dac0c99afff506 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.114354:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000060bffcb6/0xe3dac0c99afff506 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.114362:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000060bffcb6/0xe3dac0c99afff506 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.114382:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1787841947.114677:0:14310:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787841947.114686:0:14310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cd9b9e36/0xe3dac0c99afff4f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.114714:0:14310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cc00d9ca00 already unused, calling callback (ffffffffc17a4500) 00010000:00010000:2.0:1787841947.114720:0:14310:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd9b9e36/0xe3dac0c99afff4f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.114739:0:14310:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd9b9e36/0xe3dac0c99afff4f8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.114759:0:14310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cd9b9e36/0xe3dac0c99afff4f8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.114767:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd9b9e36/0xe3dac0c99afff4f8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.114784:0:14310:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787841947.114788:0:14310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b8c2380/0xe3dac0c99afff4ff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.114794:0:14310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cac3330600 already unused, calling callback (ffffffffc17a4500) 00010000:00010000:2.0:1787841947.114797:0:14310:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b8c2380/0xe3dac0c99afff4ff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.114803:0:14310:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b8c2380/0xe3dac0c99afff4ff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.114812:0:14310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b8c2380/0xe3dac0c99afff4ff lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.114818:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b8c2380/0xe3dac0c99afff4ff lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.114840:0:14310:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787841947.114842:0:14310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000060bffcb6/0xe3dac0c99afff506 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.114849:0:14310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cac3330400 already unused, calling callback (ffffffffc17a4500) 00010000:00010000:2.0:1787841947.114852:0:14310:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000060bffcb6/0xe3dac0c99afff506 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.114859:0:14310:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000060bffcb6/0xe3dac0c99afff506 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.114868:0:14310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000060bffcb6/0xe3dac0c99afff506 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.114875:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000060bffcb6/0xe3dac0c99afff506 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.114884:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841947.114886:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841947.114888:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841947.115422:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787841947.119235:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787841947.119253:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058f74f6e/0xe3dac0c99afff50d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.119276:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=487s v=(0 0) 00010000:00010000:1.0:1787841947.119281:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787841947.119289:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000058f74f6e/0xe3dac0c99afff50d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.119306:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000058f74f6e/0xe3dac0c99afff50d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.119318:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058f74f6e/0xe3dac0c99afff50d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.119327:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000058f74f6e/0xe3dac0c99afff50d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841947.119357:0:15006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1787841947.119605:0:15006:0:(ofd_dev.c:1521:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:1.0:1787841947.120651:0:15006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e2cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14344:x1874687715019136:12345-0@lo:5:osp-pre-0-0.0 Request processed in 100082us (103654us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841947.120668:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787841947.120808:0:14344:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e2c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14344:1874687715019136:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1787841947.120836:0:14344:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:1.0:1787841947.120895:0:14344:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e2c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14344:1874687715019264:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1787841947.120950:0:14344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841947.120985:0:14344:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbd14e3e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787841947.121015:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715019264 00000100:00100000:1.0:1787841947.121021:0:15006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715019264 00000100:00100000:1.0:1787841947.121077:0:15005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787841947.121086:0:15005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e2cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14344:x1874687715019264:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1787841947.121142:0:15005:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00010000:00010000:2.0:1787841947.122270:0:14310:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787841947.122284:0:14310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000058f74f6e/0xe3dac0c99afff50d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.122300:0:14310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cac3331e00 already unused, calling callback (ffffffffc17a4500) 00010000:00010000:2.0:1787841947.122312:0:14310:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000058f74f6e/0xe3dac0c99afff50d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.122325:0:14310:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000058f74f6e/0xe3dac0c99afff50d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.122351:0:14310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000058f74f6e/0xe3dac0c99afff50d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.122360:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000058f74f6e/0xe3dac0c99afff50d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841947.122385:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841947.122387:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841947.122389:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787841947.136042:0:15005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e2cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14344:x1874687715019264:12345-0@lo:5:osp-pre-0-0.0 Request processed in 14945us (15081us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1787841947.136078:0:15005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787841947.136335:0:14344:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e2c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14344:1874687715019264:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1787841947.136430:0:14344:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:1.0:1787841947.264944:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841948.288964:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787841948.589017:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:3.0:1787841948.589073:0:6717:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1787841949.314113:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841950.337914:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841951.361549:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841952.385522:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787841952.513803:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787841952.513812:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787841952.513817:0:36:0:(import.c:65:import_set_state_nolock()) ffff92cbff853000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787841952.513829:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 487 00000100:00080000:2.0:1787841952.513836:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1787841952.513845:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff92cbff853000 using connection 192.168.201.101@tcp/0@lo 00000100:00100000:2.0:1787841952.513872:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92cbff3d1a40 x1874687715019648/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787841952.513927:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff3d2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:3299:1874687715019392:0@lo:400:kworker.0 00000100:00100000:2.0:1787841952.514037:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841952.514109:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787841952.514115:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff3d0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1874687715019904:0@lo:400:kworker.0 00000100:00100000:2.0:1787841952.514144:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841952.514178:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff3d1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1874687715019648:0@lo:8:kworker.0 00000100:00100000:2.0:1787841952.514212:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841952.515122:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787841952.515138:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac3093840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687715020032:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787841952.515196:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841952.515236:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff3d0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874687715019520:0@lo:400:kworker.0 00000100:00100000:1.0:1787841952.515262:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841952.515286:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787841952.515293:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff3d1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874687715019776:0@lo:400:kworker.0 00000100:00100000:1.0:1787841952.515319:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841952.515354:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715019392 00000100:00100000:3.0:1787841952.515511:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715020032 00000100:00100000:3.0:1787841952.515518:0:15008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715020032 00000100:00100000:3.0:1787841952.515583:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787841952.515594:0:15008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e2de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874687715020032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787841952.515639:0:15008:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787841952.515693:0:15008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e2de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874687715020032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841952.515725:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787841952.515780:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715019904 00000100:00100000:3.0:1787841952.515784:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715019904 00000100:00100000:3.0:1787841952.515810:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715019776 00000100:00100000:3.0:1787841952.515812:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715019776 00000100:00100000:3.0:1787841952.515825:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787841952.515832:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff3d2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874687715019904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787841952.515879:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff3d2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874687715019904:12345-0@lo:400:kworker.0 Request processed in 47us (1734us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841952.515886:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787841952.515897:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787841952.515902:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e2da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874687715019776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787841952.515929:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e2da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874687715019776:12345-0@lo:400:kworker.0 Request processed in 27us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841952.515935:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787841952.515956:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715019648 00000100:00100000:3.0:1787841952.515960:0:15007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715019648 00000100:00100000:3.0:1787841952.515976:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715019520 00000100:00100000:3.0:1787841952.515978:0:15007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715019520 00000100:00100000:3.0:1787841952.515992:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787841952.515999:0:15007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e2c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1874687715019520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787841952.516027:0:15007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e2c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1874687715019520:12345-0@lo:400:kworker.0 Request processed in 29us (764us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841952.516033:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787841952.516042:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787841952.516046:0:15007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff3d03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3297:x1874687715019648:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1787841952.516082:0:15007:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787841952.517068:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715019392 00000100:00100000:1.0:1787841952.517137:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787841952.517146:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe9838450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+16:3299:x1874687715019392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841952.517215:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe9838450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+16:3299:x1874687715019392:12345-0@lo:400:kworker.0 Request processed in 69us (3178us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841952.517238:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:1.0:1787841952.517282:0:14318:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787841952.517288:0:14318:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787841952.517334:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92cbff3d1680 x1874687715019776/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787841968 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787841952.517350:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff3d1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874687715019776:0@lo:400:kworker.0 00000100:00100000:1.0:1787841952.517380:0:3300:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1787841952.517407:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff3d0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874687715019520:0@lo:400:kworker.0 00000100:00100000:1.0:1787841952.517449:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac3093840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687715020032:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1787841952.517784:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92cbff3d0b40 x1874687715019904/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787841968 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787841952.517796:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff3d0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1874687715019904:0@lo:400:kworker.0 00000100:00100000:2.0:1787841952.517808:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff3d2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:3299:1874687715019392:0@lo:400:kworker.0 00000100:00100000:2.0:1787841952.550906:0:15007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff3d03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3297:x1874687715019648:12345-0@lo:8:kworker.0 Request processed in 34845us (36679us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787841952.550933:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1787841952.552157:0:3297:0:(import.c:65:import_set_state_nolock()) ffff92cbff853000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787841952.552170:0:3297:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787841952.552177:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff3d1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1874687715019648:0@lo:8:kworker.0 00010000:00010000:2.0:1787841953.417444:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787841953.928611:0:14354:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:2.0:1787841954.384900:0:15725:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787841954.384905:0:15725:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1787841954.385016:0:15725:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff92cbf6eb1800 00000020:01000004:2.0:1787841954.385035:0:15725:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1787841954.385051:0:15725:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1787841954.385070:0:15725:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff92cac218ced8) 00000020:00000080:2.0:1787841954.385087:0:15725:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787841954.426937:0:15725:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787841954.427227:0:15725:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1787841954.429226:0:15725:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787841954.429964:0:15725:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1787841954.431673:0:15725:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1787841954.432130:0:15725:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 543: rc = 0 00100000:10000000:3.0:1787841954.433955:0:15725:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 543: rc = 0 00100000:10000000:3.0:1787841954.434158:0:15725:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 543: rc = 0 00010000:00010000:0.0:1787841954.434239:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1787841954.437115:0:15725:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 412: rc = 0 00100000:10000000:3.0:1787841954.438879:0:15725:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 412: rc = 0 00100000:10000000:3.0:1787841954.439979:0:15725:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 412: rc = 0 00100000:10000000:2.0:1787841954.443071:0:15725:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 412: rc = 0 00100000:10000000:2.0:1787841954.444017:0:15725:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 412: rc = 0 00100000:10000000:2.0:1787841954.445971:0:15725:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 412: rc = 0 00000020:00000080:2.0:1787841954.450057:0:15725:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1787841954.450073:0:15725:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787841954.450085:0:15725:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xe3dac0c99afff51b 00000020:01000004:2.0:1787841954.450101:0:15725:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1787841954.450126:0:15725:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.101@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787841954.450130:0:15725:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.101@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787841954.450136:0:15725:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1787841954.450160:0:15725:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1787841954.450165:0:15725:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.101@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1787841954.480373:0:15725:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.101@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787841954.480415:0:15725:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.101@tcp, index=0001, flags=0x20002 00000020:01000004:0.0:1787841954.480420:0:15725:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787841954.480421:0:15725:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787841954.480423:0:15725:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787841954.480424:0:15725:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787841954.480425:0:15725:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787841954.480427:0:15725:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787841954.480428:0:15725:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787841954.480430:0:15725:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787841954.480431:0:15725:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787841954.480435:0:15725:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:0.0:1787841954.480438:0:15725:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787841954.480439:0:15725:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787841954.480440:0:15725:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787841954.480441:0:15725:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787841954.480442:0:15725:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787841954.480443:0:15725:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787841954.480444:0:15725:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787841954.480445:0:15725:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787841954.480447:0:15725:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787841954.480474:0:15725:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787841954.480497:0:15725:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac26dc780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:15725:1874687715020160:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787841954.480582:0:15725:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841954.480649:0:15725:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc971ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1787841954.480922:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715020160 00000100:00100000:3.0:1787841954.480931:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715020160 00000100:00100000:3.0:1787841954.480987:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787841954.480996:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe7e2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+16:15725:x1874687715020160:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787841954.481024:0:14315:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1787841954.481027:0:14315:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:3.0:1787841954.481030:0:14315:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1787841954.516232:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe7e2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+16:15725:x1874687715020160:12345-0@lo:253:mount.lustre.0 Request processed in 35224us (35637us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841954.516247:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787841954.518097:0:15725:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac26dc780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:15725:1874687715020160:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787841954.518123:0:15725:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1787841954.518126:0:15725:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787841954.518128:0:15725:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787841954.518129:0:15725:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787841954.518131:0:15725:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787841954.518132:0:15725:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787841954.518133:0:15725:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787841954.518135:0:15725:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787841954.518137:0:15725:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787841954.518139:0:15725:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787841954.518164:0:15725:0:(tgt_mount.c:101:server_register_mount()) register mount ffff92cbf6eb1800 from lustre-OST0001 10000000:01000000:1.0:1787841954.518196:0:15725:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1787841954.518199:0:15725:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787841954.518209:0:15725:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff92cbe9a68000 local copy 00010000:00010000:1.0:1787841954.518220:0:15725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc149d400/0xe3dac0c99afff2c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99afff2cf expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841954.518791:0:15725:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e2c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:15725:1874687715020288:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787841954.518860:0:15725:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841954.518912:0:15725:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc82ed180 going to sleep for 11 seconds 00000100:00100000:2.0:1787841954.519048:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715020288 00000100:00100000:2.0:1787841954.519054:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715020288 00000100:00100000:2.0:1787841954.519102:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787841954.519112:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe7e2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+16:15725:x1874687715020288:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787841954.519745:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe7e2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+16:15725:x1874687715020288:12345-0@lo:501:mount.lustre.0 Request processed in 633us (882us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787841954.519755:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787841954.524531:0:15725:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e2c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:15725:1874687715020288:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787841954.524740:0:15725:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.101@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787841954.525006:0:15725:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.101@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787841954.525017:0:15725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc149d400/0xe3dac0c99afff2c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99afff2cf expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841954.525028:0:15725:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff92cbc149d400/0xe3dac0c99afff2c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99afff2cf expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787841954.525059:0:15725:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff92cbf6eb1800 10000000:01000000:1.0:1787841954.525065:0:15725:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787841954.525070:0:15725:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787841954.525073:0:15725:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787841954.525077:0:15725:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1787841954.525079:0:15725:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1787841954.525112:0:15725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cac3330800/0xe3dac0c99afff522 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841954.525121:0:15725:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff92cac3330800/0xe3dac0c99afff522 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841954.525131:0:15725:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff92cac3330800/0xe3dac0c99afff522 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841954.525165:0:15725:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e2c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:15725:1874687715020416:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787841954.525230:0:15725:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841954.525278:0:15725:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc82ed180 going to sleep for 11 seconds 00000100:00100000:0.0:1787841954.525979:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715020416 00000100:00100000:0.0:1787841954.525988:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715020416 00000100:00100000:0.0:1787841954.526053:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787841954.526064:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe7e2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+16:15725:x1874687715020416:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787841954.526078:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841954.526093:0:14315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92cbffa3a600/0xe3dac0c99afff529 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xe3dac0c99afff522 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841954.526117:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92cbffa3a600/0xe3dac0c99afff529 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe3dac0c99afff522 expref: 17 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841954.526128:0:14315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92cbffa3a600/0xe3dac0c99afff529 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe3dac0c99afff522 expref: 17 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841954.526137:0:14315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbffa3a600, rc 0) 00000100:00100000:0.0:1787841954.526203:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe7e2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+17:15725:x1874687715020416:12345-0@lo:101:mount.lustre.0 Request processed in 141us (973us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841954.526210:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787841954.526331:0:15725:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e2c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:15725:1874687715020416:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787841954.526359:0:15725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff92cac3330800/0xe3dac0c99afff522 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99afff529 expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.526376:0:15725:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff92cac3330800/0xe3dac0c99afff522 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xe3dac0c99afff529 expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787841954.527258:0:15725:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1787841954.537892:0:15725:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787841954.538163:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1787841954.538209:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1787841954.538243:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1787841954.538291:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1787841954.538328:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1787841954.538375:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1787841954.538460:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1787841954.538470:0:15725:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1787841954.538582:0:15725:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac3093c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:15725:1874687715020544:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787841954.538656:0:15725:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841954.538752:0:15725:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc8306180 going to sleep for 11 seconds 00000100:00100000:2.0:1787841954.538927:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715020544 00000100:00100000:2.0:1787841954.538935:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715020544 00000100:00100000:2.0:1787841954.538989:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787841954.538998:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe7e2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+17:15725:x1874687715020544:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787841954.539464:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe7e2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+17:15725:x1874687715020544:12345-0@lo:501:mount.lustre.0 Request processed in 466us (806us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841954.539474:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787841954.539816:0:15725:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac3093c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:15725:1874687715020544:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787841954.539869:0:15725:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e2f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:15725:1874687715020672:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787841954.539912:0:15725:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841954.539953:0:15725:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc82ed180 going to sleep for 11 seconds 00000100:00100000:2.0:1787841954.540426:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715020672 00000100:00100000:2.0:1787841954.540433:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715020672 00000100:00100000:2.0:1787841954.540477:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787841954.540485:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe7e2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+17:15725:x1874687715020672:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787841954.541725:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe7e2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+17:15725:x1874687715020672:12345-0@lo:503:mount.lustre.0 Request processed in 1231us (1803us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841954.541738:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787841954.541810:0:15725:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e2f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:15725:1874687715020672:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787841954.546389:0:15725:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787841954.546494:0:15725:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e2f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:15725:1874687715020800:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787841954.553545:0:15725:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841954.553591:0:15725:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc971ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1787841954.553607:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715020800 00000100:00100000:2.0:1787841954.553616:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715020800 00000100:00100000:2.0:1787841954.553681:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787841954.553691:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe7e2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+17:15725:x1874687715020800:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787841954.554764:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe7e2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+17:15725:x1874687715020800:12345-0@lo:502:mount.lustre.0 Request processed in 1070us (1222us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841954.554775:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787841954.555478:0:15725:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e2f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:15725:1874687715020800:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787841954.555814:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1787841954.555875:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1787841954.555905:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1787841954.555964:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1787841954.556009:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1787841954.556040:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1787841954.556093:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1787841954.556127:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1787841954.556179:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1787841954.556232:0:15725:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e2f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:15725:1874687715020928:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787841954.556316:0:15725:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841954.556371:0:15725:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc82ed180 going to sleep for 11 seconds 00000100:00100000:2.0:1787841954.559556:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715020928 00000100:00100000:2.0:1787841954.559572:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715020928 00000100:00100000:2.0:1787841954.559636:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787841954.559647:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe7e2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+17:15725:x1874687715020928:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787841954.559933:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe7e2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+17:15725:x1874687715020928:12345-0@lo:502:mount.lustre.0 Request processed in 287us (3616us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841954.559941:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787841954.560417:0:15725:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e2f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:15725:1874687715020928:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787841954.560556:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1787841954.560579:0:15725:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:1.0:1787841954.567854:0:15726:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787841954.567867:0:15726:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1787841954.567874:0:15726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787841954.567877:0:15726:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1787841954.567883:0:15726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787841954.567919:0:15726:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff92cac39fced8) 00000020:00000080:1.0:1787841954.567949:0:15726:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787841954.567956:0:15726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787841954.568020:0:15726:0:(tgt_mount.c:153:server_get_mount()) get mount ffff92cbf6eb1800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1787841954.568029:0:15726:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787841954.568034:0:15726:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xe3dac0c99afff537 00010000:00010000:2.0:1787841954.580896:0:15726:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:2.0:1787841954.581266:0:15726:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:2.0:1787841954.587043:0:15726:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1787841954.589142:0:15726:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1787841954.589156:0:15726:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787841954.589163:0:15726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787841954.589165:0:15726:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1787841954.589168:0:15726:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787841954.589172:0:15726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787841954.589174:0:15726:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787841954.589177:0:15726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787841954.589179:0:15726:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787841954.589182:0:15726:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787841954.589184:0:15726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787841954.589193:0:15726:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787841954.589197:0:15726:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787841954.589200:0:15726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787841954.589202:0:15726:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787841954.589205:0:15726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1787841954.589264:0:15726:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787841954.589267:0:15726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787841954.589269:0:15726:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787841954.589272:0:15726:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1787841954.596519:0:15725:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1787841954.596570:0:15725:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1787841954.596604:0:15725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cac3330800/0xe3dac0c99afff522 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99afff529 expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841954.596619:0:15725:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff92cac3330800/0xe3dac0c99afff522 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99afff529 expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787841954.596629:0:15725:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92cbf6eb1800 from 1 10000000:01000000:3.0:1787841954.596632:0:15725:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787841954.596676:0:15725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc149ce00/0xe3dac0c99afff53e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841954.596685:0:15725:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff92cbc149ce00/0xe3dac0c99afff53e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841954.596712:0:15725:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff92cbc149ce00/0xe3dac0c99afff53e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841954.596738:0:15725:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac3091680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:15725:1874687715021056:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787841954.596810:0:15725:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841954.596856:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715021056 00000100:00100000:3.0:1787841954.596863:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715021056 00000100:00100000:3.0:1787841954.596911:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787841954.596920:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe7e2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+17:15725:x1874687715021056:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787841954.596935:0:14316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841954.596954:0:14316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92cbc149de00/0xe3dac0c99afff545 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe3dac0c99afff53e expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841954.596979:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92cbc149de00/0xe3dac0c99afff545 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe3dac0c99afff53e expref: 18 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841954.596989:0:14316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92cbc149de00/0xe3dac0c99afff545 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe3dac0c99afff53e expref: 18 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841954.596997:0:14316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc149de00, rc 0) 00000100:00100000:3.0:1787841954.597029:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe7e2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+18:15725:x1874687715021056:12345-0@lo:101:mount.lustre.0 Request processed in 110us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841954.597036:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787841954.597079:0:15725:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc8306180 going to sleep for 11 seconds 00000100:00100000:3.0:1787841954.597099:0:15725:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac3091680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:15725:1874687715021056:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787841954.597111:0:15725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff92cbc149ce00/0xe3dac0c99afff53e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99afff545 expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841954.597120:0:15725:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff92cbc149ce00/0xe3dac0c99afff53e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe3dac0c99afff545 expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787841954.597650:0:15725:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1787841954.598111:0:15725:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787841954.598345:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1787841954.598406:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1787841954.598471:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1787841954.598479:0:15725:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1787841954.598547:0:15725:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac3091680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:15725:1874687715021184:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787841954.598598:0:15725:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841954.598643:0:15725:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc8306180 going to sleep for 11 seconds 00000100:00100000:1.0:1787841954.599234:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715021184 00000100:00100000:1.0:1787841954.599243:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715021184 00000100:00100000:1.0:1787841954.599298:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787841954.599308:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe7e2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+18:15725:x1874687715021184:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787841954.600052:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe7e2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+18:15725:x1874687715021184:12345-0@lo:501:mount.lustre.0 Request processed in 740us (1448us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841954.600064:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787841954.601694:0:15725:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac3091680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:15725:1874687715021184:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787841954.601776:0:15725:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff3d2d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:15725:1874687715021312:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787841954.601851:0:15725:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841954.601881:0:15725:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbd0be1e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787841954.602495:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715021312 00000100:00100000:3.0:1787841954.602516:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715021312 00000100:00100000:3.0:1787841954.602580:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787841954.602592:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe76e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+18:15725:x1874687715021312:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787841954.602963:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe76e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+18:15725:x1874687715021312:12345-0@lo:503:mount.lustre.0 Request processed in 373us (1111us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841954.602972:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787841954.603564:0:15725:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff3d2d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:15725:1874687715021312:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787841954.604114:0:15725:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787841954.604191:0:15725:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff3d2d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:15725:1874687715021440:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787841954.604255:0:15725:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841954.604285:0:15725:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbd0be1e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787841954.604462:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715021440 00000100:00100000:3.0:1787841954.604469:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715021440 00000100:00100000:3.0:1787841954.604632:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787841954.604640:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe76e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+18:15725:x1874687715021440:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787841954.604857:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe76e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+18:15725:x1874687715021440:12345-0@lo:502:mount.lustre.0 Request processed in 217us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841954.604865:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787841954.604911:0:15725:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff3d2d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:15725:1874687715021440:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787841954.605119:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1787841954.605163:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1787841954.605222:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1787841954.605257:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1787841954.605283:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1787841954.605334:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1787841954.607841:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1787841954.607891:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1787841954.607939:0:15725:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac3091a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:15725:1874687715021568:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787841954.608028:0:15725:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841954.608083:0:15725:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc5000480 going to sleep for 11 seconds 00000100:00100000:1.0:1787841954.608464:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715021568 00000100:00100000:1.0:1787841954.608473:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715021568 00000100:00100000:1.0:1787841954.608530:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787841954.608538:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe76e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+18:15725:x1874687715021568:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787841954.608790:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe76e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+18:15725:x1874687715021568:12345-0@lo:502:mount.lustre.0 Request processed in 251us (760us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841954.608797:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787841954.609102:0:15725:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac3091a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:15725:1874687715021568:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787841954.609230:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1787841954.609242:0:15725:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1787841954.612163:0:15730:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787841954.612179:0:15730:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787841954.612182:0:15730:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787841954.612188:0:15730:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff92cbf6eb1800 00000020:00000080:1.0:1787841954.612190:0:15730:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787841954.612198:0:15730:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787841954.612200:0:15730:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787841954.612201:0:15730:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1787841954.612203:0:15730:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787841954.612206:0:15730:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787841954.612207:0:15730:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787841954.612223:0:15730:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff92cbf6eb1800 00000020:00000080:1.0:1787841954.612225:0:15730:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787841954.612285:0:15730:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787841954.612289:0:15730:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787841954.612291:0:15730:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1787841954.612294:0:15730:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787841954.612296:0:15730:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787841954.612297:0:15730:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787841954.612301:0:15730:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff92cbf6eb1800 00000020:00000080:1.0:1787841954.612302:0:15730:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787841954.612339:0:15730:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787841954.612343:0:15730:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787841954.612344:0:15730:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1787841954.612347:0:15730:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1787841954.617189:0:15725:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1787841954.617250:0:15725:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787841954.617274:0:15725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc149ce00/0xe3dac0c99afff53e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99afff545 expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841954.617287:0:15725:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff92cbc149ce00/0xe3dac0c99afff53e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99afff545 expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787841954.617357:0:15725:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787841954.617369:0:15725:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff92cbf6eb1800 10000000:01000000:3.0:1787841954.617372:0:15725:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff92cbf6eb1800 10000000:01000000:3.0:1787841954.617376:0:15725:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787841954.617381:0:15725:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff92cbf6eb1800 from 1 10000000:01000000:3.0:1787841954.617383:0:15725:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787841954.617418:0:15725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc149c800/0xe3dac0c99afff54c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841954.617425:0:15725:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff92cbc149c800/0xe3dac0c99afff54c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841954.617436:0:15725:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff92cbc149c800/0xe3dac0c99afff54c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841954.617459:0:15725:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac30921c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:15725:1874687715021696:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787841954.617537:0:15725:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841954.617579:0:15725:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc5000480 going to sleep for 11 seconds 00000100:00100000:2.0:1787841954.627155:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715021696 00000100:00100000:2.0:1787841954.627171:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715021696 00000100:00100000:2.0:1787841954.627254:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787841954.627267:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe76e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+18:15725:x1874687715021696:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787841954.627285:0:14317:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841954.627306:0:14317:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92cbc6104800/0xe3dac0c99afff553 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xe3dac0c99afff54c expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.627336:0:14317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92cbc6104800/0xe3dac0c99afff553 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe3dac0c99afff54c expref: 19 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.627348:0:14317:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92cbc6104800/0xe3dac0c99afff553 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe3dac0c99afff54c expref: 19 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.627370:0:14317:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc6104800, rc 0) 00000100:00100000:2.0:1787841954.629691:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe76e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+19:15725:x1874687715021696:12345-0@lo:101:mount.lustre.0 Request processed in 2416us (12141us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841954.629737:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787841954.636220:0:15725:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac30921c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:15725:1874687715021696:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787841954.636261:0:15725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff92cbc149c800/0xe3dac0c99afff54c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99afff553 expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841954.636277:0:15725:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff92cbc149c800/0xe3dac0c99afff54c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xe3dac0c99afff553 expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787841954.637031:0:15725:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1787841954.637348:0:15725:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787841954.637654:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1787841954.637738:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1787841954.637777:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1787841954.637827:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1787841954.637864:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1787841954.637914:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1787841954.637950:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1787841954.637982:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1787841954.638031:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1787841954.638065:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1787841954.638092:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1787841954.638132:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1787841954.638166:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1787841954.638199:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1787841954.638243:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1787841954.638277:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1787841954.638309:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1787841954.638388:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1787841954.638428:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1787841954.638458:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1787841954.638501:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1787841954.638538:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1787841954.638570:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1787841954.638617:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1787841954.638654:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1787841954.638686:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1787841954.638766:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1787841954.638802:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1787841954.638835:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1787841954.638896:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:3.0:1787841954.638932:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:3.0:1787841954.638966:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:3.0:1787841954.639001:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:3.0:1787841954.639067:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:3.0:1787841954.639105:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:3.0:1787841954.639167:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:3.0:1787841954.639207:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:3.0:1787841954.639302:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:3.0:1787841954.639312:0:15725:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1787841954.645311:0:15725:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac30921c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:15725:1874687715021824:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787841954.645394:0:15725:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841954.645592:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715021824 00000100:00100000:0.0:1787841954.645601:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715021824 00000100:00100000:0.0:1787841954.645667:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787841954.645676:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe76e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+19:15725:x1874687715021824:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787841954.645964:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe76e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+19:15725:x1874687715021824:12345-0@lo:501:mount.lustre.0 Request processed in 288us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841954.645972:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787841954.647724:0:15725:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc5000480 going to sleep for 11 seconds 00000100:00100000:3.0:1787841954.647761:0:15725:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac30921c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:15725:1874687715021824:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787841954.647815:0:15725:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac30921c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:15725:1874687715021952:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787841954.647881:0:15725:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841954.647917:0:15725:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc5000480 going to sleep for 11 seconds 00000100:00100000:3.0:1787841954.649305:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715021952 00000100:00100000:3.0:1787841954.649316:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715021952 00000100:00100000:3.0:1787841954.649391:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787841954.649402:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe76e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+19:15725:x1874687715021952:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787841954.649922:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe76e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+19:15725:x1874687715021952:12345-0@lo:503:mount.lustre.0 Request processed in 520us (2039us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841954.649931:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787841954.649998:0:15725:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac30921c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:15725:1874687715021952:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787841954.651987:0:15725:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787841954.653719:0:15725:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac30921c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:15725:1874687715022080:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787841954.653804:0:15725:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841954.653842:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715022080 00000100:00100000:3.0:1787841954.653848:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715022080 00000100:00100000:3.0:1787841954.653892:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787841954.653900:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe76e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+19:15725:x1874687715022080:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787841954.656318:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe76e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+19:15725:x1874687715022080:12345-0@lo:502:mount.lustre.0 Request processed in 2409us (2506us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841954.656331:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787841954.656432:0:15725:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc82ed6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787841954.656463:0:15725:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac30921c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:15725:1874687715022080:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787841954.656927:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1787841954.656994:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1787841954.657030:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1787841954.657242:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1787841954.657284:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1787841954.657348:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1787841954.658355:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1787841954.658417:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1787841954.658637:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1787841954.658673:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1787841954.658726:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1787841954.658780:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1787841954.658817:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1787841954.658856:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1787841954.658903:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1787841954.658942:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1787841954.658978:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1787841954.659027:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1787841954.660284:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1787841954.660354:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1787841954.660430:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1787841954.661467:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1787841954.661637:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1787841954.661719:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1787841954.661768:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1787841954.661797:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1787841954.661838:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1787841954.661867:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1787841954.661894:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1787841954.661931:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1787841954.661960:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1787841954.661986:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1787841954.662013:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1787841954.662595:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1787841954.662651:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1787841954.662695:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1787841954.662754:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1787841954.662782:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1787841954.662822:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1787841954.662852:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1787841954.662899:0:15725:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac30921c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:15725:1874687715022208:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787841954.662972:0:15725:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841954.663017:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715022208 00000100:00100000:3.0:1787841954.663022:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715022208 00000100:00100000:3.0:1787841954.663074:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787841954.663082:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe76e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+19:15725:x1874687715022208:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787841954.663278:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe76e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+19:15725:x1874687715022208:12345-0@lo:502:mount.lustre.0 Request processed in 196us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841954.663286:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787841954.663336:0:15725:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc82ed6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787841954.663355:0:15725:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac30921c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:15725:1874687715022208:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787841954.663432:0:15725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1787841954.667254:0:15725:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1787841954.672763:0:15735:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1787841954.672782:0:15735:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff92cbf426b490) 00000020:00000080:3.0:1787841954.672806:0:15735:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:3.0:1787841954.672879:0:15735:0:(tgt_mount.c:153:server_get_mount()) get mount ffff92cbf6eb1800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787841954.672884:0:15735:0:(tgt_mount.c:187:server_put_mount()) put mount ffff92cbf6eb1800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787841954.672886:0:15735:0:(obd_mount.c:710:lustre_put_lsi()) put ffff92cbf6eb1800 3 00010000:00080000:3.0:1787841954.672915:0:15735:0:(ldlm_lib.c:102:import_set_conn()) imp ffff92cbd0ab7000@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.101@tcp at head 00010000:00010000:3.0:1787841954.676901:0:15735:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:3.0:1787841954.677142:0:15735:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1787841954.677185:0:15735:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787841954.677205:0:15735:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xe3dac0c99afff561 00000100:00080000:3.0:1787841954.677220:0:15735:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787841954.677228:0:15735:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff92cbd0ab7000 using connection 192.168.201.101@tcp/0@lo 00000100:00100000:3.0:1787841954.677272:0:15735:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92cac30921c0 x1874687715022336/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787841954.677302:0:15735:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787841954.678940:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787841954.678946:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787841954.678950:0:36:0:(import.c:65:import_set_state_nolock()) ffff92cbff853000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787841954.678958:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 492 00000100:00080000:0.0:1787841954.678963:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1787841954.678969:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff92cbff853000 using connection 192.168.201.101@tcp/0@lo 00000100:00100000:0.0:1787841954.678991:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92cac26df0c0 x1874687715022592/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787841954.679040:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787841954.679069:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac26dcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1874687715022848:0@lo:400:kworker.0 00000100:00100000:0.0:1787841954.679143:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841954.679196:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715022848 00000100:00100000:0.0:1787841954.679209:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715022848 00000100:00100000:0.0:1787841954.679266:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787841954.679276:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac26df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874687715022848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841954.679328:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac26df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874687715022848:12345-0@lo:400:kworker.0 Request processed in 54us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841954.679335:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1787841954.679384:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92cac26dcf00 x1874687715022848/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787841970 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787841954.679397:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac26dcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1874687715022848:0@lo:400:kworker.0 00000100:00100000:2.0:1787841954.679539:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac30921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3297:1874687715022336:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787841954.679572:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841954.679604:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac26df0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1874687715022592:0@lo:8:kworker.0 00000100:00100000:2.0:1787841954.679628:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841954.679660:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715022592 00000100:00100000:2.0:1787841954.679664:0:15006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715022592 00000100:00100000:2.0:1787841954.679686:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787841954.679692:0:15006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff3d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3297:x1874687715022592:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1787841954.679759:0:15006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff3d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3297:x1874687715022592:12345-0@lo:8:kworker.0 Request processed in 66us (130us total) trans 0 rc -11/-11 00000100:00100000:2.0:1787841954.679766:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787841954.679793:0:3297:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787841954.679799:0:3297:0:(import.c:65:import_set_state_nolock()) ffff92cbff853000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787841954.679802:0:3297:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1787841954.679806:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac26df0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1874687715022592:0@lo:8:kworker.0 00000040:00080000:3.0:1787841954.680395:0:15735:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00100000:0.0:1787841954.680712:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715022336 00000100:00100000:0.0:1787841954.680718:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715022336 00000100:00100000:0.0:1787841954.680744:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787841954.680749:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff3d3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3297:x1874687715022336:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787841954.680770:0:14323:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 494 last 0 00000020:00000080:0.0:1787841954.680800:0:14323:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xe3dac0c99afff568 00000004:00100000:0.0:1787841954.680815:0:14323:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787841954.680843:0:14323:0:(import.c:65:import_set_state_nolock()) ffff92cac3159000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787841954.680898:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff3d3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1874687715022336:12345-0@lo:38:llog_process_th.0 Request processed in 148us (1325us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841954.680906:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787841954.680945:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92cac30921c0 x1874687715022336/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787841964 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787841954.680956:0:3297:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787841954.680962:0:3297:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1787841954.680969:0:3297:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787841954.680973:0:3297:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787841954.680980:0:3297:0:(import.c:65:import_set_state_nolock()) ffff92cbd0ab7000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787841954.680986:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac30921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3297:1874687715022336:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787841954.681528:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac26dfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874687715022464:0@lo:400:kworker.0 00000100:00100000:1.0:1787841954.681574:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841954.681609:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787841954.681616:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac26de940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874687715022720:0@lo:400:kworker.0 00000100:00100000:1.0:1787841954.681639:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787841954.681674:0:14318:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:01000000:1.0:1787841954.681692:0:15725:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1787841954.681739:0:15725:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787841954.681754:0:15725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc149c800/0xe3dac0c99afff54c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99afff553 expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841954.681766:0:15725:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff92cbc149c800/0xe3dac0c99afff54c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99afff553 expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787841954.681816:0:15725:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787841954.681819:0:15725:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787841954.681820:0:15725:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787841954.681824:0:15725:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787841954.681825:0:15725:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787841954.681826:0:15725:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787841954.681828:0:15725:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787841954.681829:0:15725:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787841954.681831:0:15725:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787841954.681834:0:15725:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1787841954.681837:0:15725:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787841954.681838:0:15725:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787841954.681839:0:15725:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787841954.681840:0:15725:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787841954.681841:0:15725:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787841954.681842:0:15725:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787841954.681843:0:15725:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787841954.681844:0:15725:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787841954.681845:0:15725:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787841954.681862:0:15725:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1787841954.681874:0:15725:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e2f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:15725:1874687715022976:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787841954.681915:0:15725:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841954.681942:0:15725:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbd5a86900 going to sleep for 11 seconds 00000100:00100000:2.0:1787841954.683001:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715022464 00000100:00100000:2.0:1787841954.683009:0:15007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715022464 00000100:00100000:2.0:1787841954.683160:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787841954.683169:0:15007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e2ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1874687715022464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841954.683227:0:15007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e2ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1874687715022464:12345-0@lo:400:kworker.0 Request processed in 60us (1654us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841954.683234:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1787841954.683332:0:14318:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787841954.683370:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac26dfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874687715022464:0@lo:400:kworker.0 00000100:00100000:0.0:1787841954.683465:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715022720 00000100:00100000:0.0:1787841954.683470:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715022720 00000100:00100000:0.0:1787841954.683574:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787841954.683582:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e2e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874687715022720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841954.683626:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e2e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874687715022720:12345-0@lo:400:kworker.0 Request processed in 45us (1985us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841954.683632:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787841954.684690:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715022976 00000100:00100000:3.0:1787841954.684724:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715022976 00000100:00100000:3.0:1787841954.684763:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787841954.684772:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe76e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+19:15725:x1874687715022976:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787841954.684798:0:14317:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1787841954.684813:0:14317:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:1.0:1787841954.685513:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92cac26de940 x1874687715022720/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787841970 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787841954.685528:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac26de940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874687715022720:0@lo:400:kworker.0 20000000:01000000:2.0:1787841954.782274:0:14317:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787841954.782285:0:14317:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1787841954.782463:0:14338:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787841954.782468:0:14338:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787841954.782486:0:14338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff92cbffa3ae00/0xe3dac0c99afff56f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841954.782505:0:14338:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92cbffa3aa00/0xe3dac0c99afff449 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe3dac0c99afff442 expref: 19 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841954.782513:0:14338:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff92cbffa3ae00/0xe3dac0c99afff56f lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841954.782547:0:14338:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92cbffa3aa00/0xe3dac0c99afff449 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe3dac0c99afff442 expref: 19 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841954.782562:0:14338:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92cbffa3aa00/0xe3dac0c99afff449 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe3dac0c99afff442 expref: 19 pid: 14317 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841954.782576:0:14338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac26dcf00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14338:1874687715023104:0@lo:104: 00000100:00100000:0.0:1787841954.782637:0:14338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841954.782678:0:14338:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc2e21180 going to sleep for 11 seconds 00000100:00100000:3.0:1787841954.782848:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715023104 00000100:00100000:3.0:1787841954.782859:0:14306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715023104 00000100:00100000:3.0:1787841954.782906:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787841954.782913:0:14306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac26de1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+3:14338:x1874687715023104:12345-0@lo:104: 00010000:00010000:3.0:1787841954.782925:0:14306:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.101@tcp lock: ffff92cbc149d600/0xe3dac0c99afff442 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe3dac0c99afff449 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841954.782968:0:14306:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787841954.782973:0:14306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac26de1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+3:14338:x1874687715023104:12345-0@lo:104: Request processed in 61us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841954.782980:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1787841954.783038:0:14311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787841954.783048:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.101@tcp lock: ffff92cbc149d600/0xe3dac0c99afff442 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe3dac0c99afff449 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.783065:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc149d600 already unused, calling callback (ffffffffc1d9fc20) 10000000:00010000:2.0:1787841954.783070:0:14311:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.101@tcp lock: ffff92cbc149d600/0xe3dac0c99afff442 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe3dac0c99afff449 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.783078:0:14311:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.101@tcp lock: ffff92cbc149d600/0xe3dac0c99afff442 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe3dac0c99afff449 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787841954.783086:0:14311:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.101@tcp lock: ffff92cbc149d600/0xe3dac0c99afff442 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe3dac0c99afff449 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787841954.783091:0:14311:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787841954.783121:0:14311:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.101@tcp lock: ffff92cbc149d600/0xe3dac0c99afff442 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99afff449 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.783127:0:14311:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787841954.783150:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.101@tcp lock: ffff92cbc149d600/0xe3dac0c99afff442 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99afff449 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.783157:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.101@tcp lock: ffff92cbc149d600/0xe3dac0c99afff442 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99afff449 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841954.783172:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841954.783174:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841954.783175:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787841954.783181:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787841954.783191:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff3d3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:3298:1874687715023232:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787841954.783219:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841954.783964:0:14338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac26dcf00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14338:1874687715023104:0@lo:104: 00010000:00010000:0.0:1787841954.783987:0:14338:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff92cbffa3ae00/0xe3dac0c99afff56f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841954.784010:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715023232 00000100:00100000:0.0:1787841954.784015:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715023232 00010000:00010000:0.0:1787841954.784035:0:14308:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92cbffa3aa00/0xe3dac0c99afff449 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe3dac0c99afff442 expref: 20 pid: 14317 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841954.784074:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787841954.784082:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff3d2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+20:3298:x1874687715023232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787841954.784095:0:14308:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787841954.784099:0:14308:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92cbffa3aa00/0xe3dac0c99afff449 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe3dac0c99afff442 expref: 20 pid: 14317 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841954.784110:0:14308:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92cbffa3aa00/0xe3dac0c99afff449 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe3dac0c99afff442 expref: 20 pid: 14317 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841954.784127:0:14308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92cbffa3aa00/0xe3dac0c99afff449 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe3dac0c99afff442 expref: 20 pid: 14317 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841954.784144:0:14308:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff92cbffa3ae00/0xe3dac0c99afff56f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841954.784151:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92cbffa3ae00/0xe3dac0c99afff56f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787841954.784165:0:14308:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001697533s 00010000:00010000:0.0:1787841954.784169:0:14308:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92cbffa3ae00/0xe3dac0c99afff56f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841954.784187:0:14308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92cbffa3ae00/0xe3dac0c99afff56f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841954.784194:0:14308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff92cbffa3ae00/0xe3dac0c99afff56f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841954.784200:0:14308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff92cbffa3ae00/0xe3dac0c99afff56f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841954.784205:0:14308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbffa3ae00 already unused, calling callback (ffffffffc17a4500) 00010000:00010000:0.0:1787841954.784209:0:14308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff92cbffa3ae00/0xe3dac0c99afff56f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841954.784216:0:14308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff92cbffa3ae00/0xe3dac0c99afff56f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841954.784235:0:14308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff92cbffa3ae00/0xe3dac0c99afff56f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841954.784243:0:14308:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787841954.784283:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff3d2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+19:3298:x1874687715023232:12345-0@lo:103:ldlm_bl.0 Request processed in 202us (1062us total) trans 0 rc 0/0 00010000:00010000:1.0:1787841954.784286:0:14338:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff92cbffa3ae00/0xe3dac0c99afff56f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841954.784290:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1787841954.784294:0:14338:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff92cbffa3ae00/0xe3dac0c99afff56f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841954.784300:0:14338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92cbffa3ae00/0xe3dac0c99afff56f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841954.784319:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff3d3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:3298:1874687715023232:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787841954.802650:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe76e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+18:15725:x1874687715022976:12345-0@lo:253:mount.lustre.0 Request processed in 117871us (120724us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841954.802665:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787841954.802797:0:15725:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e2f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:15725:1874687715022976:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787841954.802814:0:15725:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1787841954.802817:0:15725:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787841954.802819:0:15725:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787841954.802820:0:15725:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787841954.802821:0:15725:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787841954.802822:0:15725:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787841954.802824:0:15725:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787841954.802826:0:15725:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787841954.802828:0:15725:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787841954.802829:0:15725:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787841954.802844:0:15725:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1787841954.807992:0:15725:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1787841954.808122:0:15725:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1787841954.808267:0:15725:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1787841954.813671:0:15725:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1787841954.815264:0:15725:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1787841954.816344:0:15725:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1787841954.821537:0:15725:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1787841954.976410:0:15725:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1787841954.976421:0:15725:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1787841954.976471:0:15725:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787841954.976531:0:15725:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.101@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787841954.976548:0:15725:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1787841954.976583:0:15725:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1787841955.456906:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787841956.226034:0:14319:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787841956.226043:0:14319:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff92cac3549800 from 8 10000000:01000000:1.0:1787841956.226048:0:14319:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787841956.226097:0:14319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cac3330200/0xe3dac0c99afff576 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841956.226110:0:14319:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff92cac3330200/0xe3dac0c99afff576 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841956.226131:0:14319:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff92cac3330200/0xe3dac0c99afff576 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841956.226157:0:14319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e2f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:14319:1874687715023360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787841956.226236:0:14319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841956.226295:0:14319:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbda4d1000 going to sleep for 11 seconds 00000100:00100000:2.0:1787841956.226365:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715023360 00000100:00100000:2.0:1787841956.226372:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715023360 00000100:00100000:2.0:1787841956.226424:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787841956.226433:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe76e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+18:14319:x1874687715023360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787841956.226447:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841956.226461:0:14315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92cbc6104a00/0xe3dac0c99afff57d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe3dac0c99afff576 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841956.226493:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92cbc6104a00/0xe3dac0c99afff57d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe3dac0c99afff576 expref: 19 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841956.226503:0:14315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92cbc6104a00/0xe3dac0c99afff57d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe3dac0c99afff576 expref: 19 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841956.226512:0:14315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc6104a00, rc 0) 00000100:00100000:2.0:1787841956.226554:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe76e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+19:14319:x1874687715023360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841956.226561:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787841956.226691:0:14319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e2f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:14319:1874687715023360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787841956.226733:0:14319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff92cac3330200/0xe3dac0c99afff576 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99afff57d expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841956.226741:0:14319:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff92cac3330200/0xe3dac0c99afff576 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe3dac0c99afff57d expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841956.226785:0:14319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e2f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:14319:1874687715023488:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787841956.226813:0:14319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841956.226830:0:14319:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbda4d1000 going to sleep for 11 seconds 00000100:00100000:0.0:1787841956.226909:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715023488 00000100:00100000:0.0:1787841956.226913:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715023488 00000100:00100000:0.0:1787841956.226940:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787841956.226947:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe76e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+19:14319:x1874687715023488:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787841956.226960:0:14316:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787841956.226976:0:14316:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787841956.226979:0:14316:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1787841956.227052:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe76e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+19:14319:x1874687715023488:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 105us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841956.227059:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787841956.227194:0:14319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e2f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:14319:1874687715023488:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787841956.227250:0:14319:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787841956.227258:0:14319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cac3330200/0xe3dac0c99afff576 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99afff57d expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841956.227266:0:14319:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff92cac3330200/0xe3dac0c99afff576 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99afff57d expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841956.486602:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841957.506068:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787841957.634106:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787841957.634143:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e2f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874687715023616:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787841957.634243:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841957.634410:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715023616 00000100:00100000:1.0:1787841957.634422:0:15008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715023616 00000100:00100000:1.0:1787841957.634513:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787841957.634526:0:15008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac26dde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874687715023616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787841957.634582:0:15008:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787841957.634642:0:15008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac26dde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874687715023616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841957.634650:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1787841957.634732:0:14318:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787841957.634778:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e2f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874687715023616:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787841958.529264:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841959.553617:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787841959.682611:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787841959.682618:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787841959.682623:0:36:0:(import.c:65:import_set_state_nolock()) ffff92cbff853000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787841959.682639:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff92cbff853000 using connection 192.168.201.101@tcp/0@lo 00000100:00100000:2.0:1787841959.682667:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92cbff3d1680 x1874687715024000/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787841959.682749:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff3d0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1874687715024256:0@lo:400:kworker.0 00000100:00100000:2.0:1787841959.682866:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841959.682944:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787841959.682950:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff3d1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:3300:1874687715023744:0@lo:400:kworker.0 00000100:00100000:2.0:1787841959.682979:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841959.683001:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff3d3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1874687715024384:0@lo:400:kworker.0 00000100:00100000:2.0:1787841959.683022:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841959.683047:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff3d0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687715023872:0@lo:400:kworker.0 00000100:00100000:2.0:1787841959.683076:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841959.683096:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787841959.683101:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff3d2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874687715024128:0@lo:400:kworker.0 00000100:00100000:2.0:1787841959.683123:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841959.683155:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715024256 00000100:00100000:2.0:1787841959.683162:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715024256 00000100:00100000:2.0:1787841959.683222:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715024384 00000100:00100000:2.0:1787841959.683228:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715024384 00000100:00100000:2.0:1787841959.683243:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715024128 00000100:00100000:2.0:1787841959.683245:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715024128 00000100:00100000:2.0:1787841959.683260:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787841959.683268:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbd4bb3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874687715024256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841959.683346:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbd4bb3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874687715024256:12345-0@lo:400:kworker.0 Request processed in 77us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841959.683354:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787841959.683374:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787841959.683380:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbd4bb30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874687715024384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841959.683407:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbd4bb30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874687715024384:12345-0@lo:400:kworker.0 Request processed in 28us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841959.683412:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787841959.683433:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787841959.683439:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbd4bb0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874687715024128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841959.683471:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbd4bb0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874687715024128:12345-0@lo:400:kworker.0 Request processed in 33us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841959.683477:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787841959.683497:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715023744 00000100:00100000:2.0:1787841959.683501:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715023744 00000100:00100000:2.0:1787841959.683529:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787841959.683535:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe76e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+19:3300:x1874687715023744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841959.683565:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe76e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+19:3300:x1874687715023744:12345-0@lo:400:kworker.0 Request processed in 30us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841959.683571:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787841959.683603:0:15005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715023872 00000100:00100000:2.0:1787841959.683607:0:15005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715023872 00000100:00100000:2.0:1787841959.683641:0:15005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787841959.683647:0:15005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbd4bb1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1874687715023872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841959.683676:0:15005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbd4bb1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1874687715023872:12345-0@lo:400:kworker.0 Request processed in 30us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841959.683681:0:15005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1787841959.683732:0:14318:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787841959.683738:0:14318:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787841959.683778:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbff3d2940 x1874687715024128/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787841975 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787841959.683795:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff3d2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874687715024128:0@lo:400:kworker.0 00000100:00100000:2.0:1787841959.683806:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff3d0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687715023872:0@lo:400:kworker.0 00000100:00100000:2.0:1787841959.683837:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff3d1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:3300:1874687715023744:0@lo:400:kworker.0 00010000:00080000:2.0:1787841959.683857:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbff3d3840 x1874687715024384/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787841975 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787841959.683866:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff3d3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1874687715024384:0@lo:400:kworker.0 00010000:00080000:2.0:1787841959.683876:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbff3d0b40 x1874687715024256/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787841975 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787841959.683884:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff3d0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1874687715024256:0@lo:400:kworker.0 00000100:00100000:0.0:1787841959.684061:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff3d1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1874687715024000:0@lo:8:kworker.0 00000100:00100000:0.0:1787841959.684102:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841959.684178:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715024000 00000100:00100000:2.0:1787841959.684183:0:15006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715024000 00000100:00100000:2.0:1787841959.685037:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787841959.685047:0:15006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac26df840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3297:x1874687715024000:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1787841959.685092:0:15006:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 499 last 0 00000020:00000080:2.0:1787841959.685140:0:15006:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe3dac0c99afff584 00002000:00100000:2.0:1787841959.685163:0:15006:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff92cbf07dc800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211395f ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1787841959.685169:0:15006:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1787841959.685173:0:15006:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787841959.685655:0:15006:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787841959.685691:0:15006:0:(import.c:65:import_set_state_nolock()) ffff92cbf07df000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787841959.685825:0:15006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac26df840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3297:x1874687715024000:12345-0@lo:8:kworker.0 Request processed in 777us (1721us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841959.685834:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1787841959.690311:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbff3d1680 x1874687715024000/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787841984 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787841959.690339:0:3297:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1787841959.690351:0:3297:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787841959.690359:0:3297:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1787841959.690363:0:3297:0:(import.c:65:import_set_state_nolock()) ffff92cbff853000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787841959.690427:0:3297:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787841959.690436:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff3d1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3297:1874687715024000:0@lo:8:kworker.0 00000004:00080000:0.0:1787841959.690540:0:14347:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:0.0:1787841959.690567:0:14347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac26dcf00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14347:1874687715024640:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1787841959.690647:0:14347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841959.690686:0:14347:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbe9984840 going to sleep for 11 seconds 00000100:00100000:0.0:1787841959.690721:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787841959.690730:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac26de580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874687715024512:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787841959.690759:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841959.690816:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715024512 00000100:00100000:0.0:1787841959.690824:0:15008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715024512 00000100:00100000:0.0:1787841959.690978:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787841959.690992:0:15008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac26dfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3299:x1874687715024512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787841959.691042:0:15008:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787841959.691094:0:15008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac26dfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3299:x1874687715024512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841959.691103:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787841959.691144:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cac26de580 x1874687715024512/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787841975 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787841959.691161:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac26de580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874687715024512:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787841959.691186:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715024640 00000100:00100000:0.0:1787841959.691189:0:15007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715024640 00000100:00100000:0.0:1787841959.691215:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787841959.691222:0:15007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac26de940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14347:x1874687715024640:12345-0@lo:5:osp-pre-1-0.0 00000100:00080000:2.0:1787841959.692064:0:14318:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1787841959.693577:0:14345:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787841959.697182:0:14345:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 499695479558ns, next at 0ns, rc = 0 00002000:00080000:0.0:1787841959.706289:0:15007:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1787841959.706310:0:15007:0:(ofd_dev.c:1643:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1787841959.706318:0:15007:0:(ofd_dev.c:1494:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00002000:00010000:0.0:1787841959.712801:0:15007:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787841959.712819:0:15007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f112014f/0xe3dac0c99afff58b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.712837:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=499s v=(0 0) 00010000:00010000:0.0:1787841959.712841:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787841959.712847:0:15007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f112014f/0xe3dac0c99afff58b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.712866:0:15007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f112014f/0xe3dac0c99afff58b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.712875:0:15007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f112014f/0xe3dac0c99afff58b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.712880:0:15007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f112014f/0xe3dac0c99afff58b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.712900:0:15007:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787841959.716425:0:14311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787841959.716442:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f112014f/0xe3dac0c99afff58b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841959.716468:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbffa3aa00 already unused, calling callback (ffffffffc17a4500) 00010000:00010000:2.0:1787841959.716473:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f112014f/0xe3dac0c99afff58b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841959.716487:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f112014f/0xe3dac0c99afff58b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841959.716521:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f112014f/0xe3dac0c99afff58b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841959.716530:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f112014f/0xe3dac0c99afff58b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841959.716558:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841959.716559:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841959.716560:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787841959.724564:0:15007:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787841959.724581:0:15007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000237154b5/0xe3dac0c99afff592 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.724600:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=499s v=(0 0) 00010000:00010000:0.0:1787841959.724604:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787841959.724611:0:15007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000237154b5/0xe3dac0c99afff592 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.724629:0:15007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000237154b5/0xe3dac0c99afff592 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.724647:0:15007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000237154b5/0xe3dac0c99afff592 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.724654:0:15007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000237154b5/0xe3dac0c99afff592 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.724677:0:15007:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787841959.724694:0:14310:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787841959.724730:0:14310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000237154b5/0xe3dac0c99afff592 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.724737:0:14310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbffa3ae00 already unused, calling callback (ffffffffc17a4500) 00010000:00010000:0.0:1787841959.724740:0:14310:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000237154b5/0xe3dac0c99afff592 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.724749:0:14310:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000237154b5/0xe3dac0c99afff592 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.724765:0:14310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000237154b5/0xe3dac0c99afff592 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.724770:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000237154b5/0xe3dac0c99afff592 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.724785:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841959.724791:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841959.724793:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787841959.725399:0:15007:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787841959.725408:0:15007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001facac3f/0xe3dac0c99afff599 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.725419:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=499s v=(0 0) 00010000:00010000:0.0:1787841959.725422:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787841959.725428:0:15007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001facac3f/0xe3dac0c99afff599 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.725439:0:15007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001facac3f/0xe3dac0c99afff599 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.725450:0:15007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001facac3f/0xe3dac0c99afff599 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.725457:0:15007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001facac3f/0xe3dac0c99afff599 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.725474:0:15007:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787841959.725933:0:15007:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787841959.725939:0:15007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000469f73d2/0xe3dac0c99afff5a0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.725948:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=499s v=(0 0) 00010000:00010000:0.0:1787841959.725950:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787841959.725953:0:15007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000469f73d2/0xe3dac0c99afff5a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.725964:0:15007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000469f73d2/0xe3dac0c99afff5a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.725971:0:15007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000469f73d2/0xe3dac0c99afff5a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.725975:0:15007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000469f73d2/0xe3dac0c99afff5a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.725986:0:15007:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787841959.726000:0:14310:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787841959.726004:0:14310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001facac3f/0xe3dac0c99afff599 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.726009:0:14310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbffa3be00 already unused, calling callback (ffffffffc17a4500) 00010000:00010000:0.0:1787841959.726011:0:14310:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001facac3f/0xe3dac0c99afff599 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.726020:0:14310:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001facac3f/0xe3dac0c99afff599 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.726035:0:14310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001facac3f/0xe3dac0c99afff599 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.726044:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001facac3f/0xe3dac0c99afff599 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.726066:0:14310:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787841959.726070:0:14310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000469f73d2/0xe3dac0c99afff5a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.726077:0:14310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbffa3ba00 already unused, calling callback (ffffffffc17a4500) 00010000:00010000:0.0:1787841959.726081:0:14310:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000469f73d2/0xe3dac0c99afff5a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.726089:0:14310:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000469f73d2/0xe3dac0c99afff5a0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.726099:0:14310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000469f73d2/0xe3dac0c99afff5a0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.726106:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000469f73d2/0xe3dac0c99afff5a0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.726118:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841959.726119:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841959.726122:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787841959.726581:0:15007:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787841959.726586:0:15007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b70be7c/0xe3dac0c99afff5a7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.726595:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=499s v=(0 0) 00010000:00010000:0.0:1787841959.726602:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787841959.726605:0:15007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b70be7c/0xe3dac0c99afff5a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.726614:0:15007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003b70be7c/0xe3dac0c99afff5a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.726620:0:15007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b70be7c/0xe3dac0c99afff5a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.726625:0:15007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003b70be7c/0xe3dac0c99afff5a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.726638:0:15007:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787841959.726647:0:14310:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787841959.726650:0:14310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003b70be7c/0xe3dac0c99afff5a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.726654:0:14310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbffa3a000 already unused, calling callback (ffffffffc17a4500) 00010000:00010000:0.0:1787841959.726656:0:14310:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003b70be7c/0xe3dac0c99afff5a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.726661:0:14310:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003b70be7c/0xe3dac0c99afff5a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.726667:0:14310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003b70be7c/0xe3dac0c99afff5a7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.726680:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003b70be7c/0xe3dac0c99afff5a7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.726692:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841959.726693:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841959.726694:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787841959.727039:0:15007:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787841959.727045:0:15007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e650786e/0xe3dac0c99afff5ae lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.727055:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=499s v=(0 0) 00010000:00010000:0.0:1787841959.727058:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787841959.727062:0:15007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e650786e/0xe3dac0c99afff5ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.727072:0:15007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e650786e/0xe3dac0c99afff5ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.727080:0:15007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e650786e/0xe3dac0c99afff5ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.727087:0:15007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e650786e/0xe3dac0c99afff5ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.727102:0:15007:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787841959.727110:0:14310:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787841959.727120:0:14310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e650786e/0xe3dac0c99afff5ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.727128:0:14310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbffa3ac00 already unused, calling callback (ffffffffc17a4500) 00010000:00010000:0.0:1787841959.727131:0:14310:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e650786e/0xe3dac0c99afff5ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.727139:0:14310:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e650786e/0xe3dac0c99afff5ae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.727150:0:14310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e650786e/0xe3dac0c99afff5ae lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.727157:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e650786e/0xe3dac0c99afff5ae lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.727170:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841959.727172:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841959.727173:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841959.736766:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787841959.747440:0:15007:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787841959.747458:0:15007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000237154b5/0xe3dac0c99afff5b5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.747481:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=499s v=(0 0) 00010000:00010000:0.0:1787841959.747488:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787841959.747496:0:15007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000237154b5/0xe3dac0c99afff5b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.747530:0:15007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000237154b5/0xe3dac0c99afff5b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.747543:0:15007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000237154b5/0xe3dac0c99afff5b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.747551:0:15007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000237154b5/0xe3dac0c99afff5b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.747580:0:15007:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787841959.747601:0:14310:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787841959.747609:0:14310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000237154b5/0xe3dac0c99afff5b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.747618:0:14310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbffa3ae00 already unused, calling callback (ffffffffc17a4500) 00010000:00010000:0.0:1787841959.747623:0:14310:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000237154b5/0xe3dac0c99afff5b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.747633:0:14310:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000237154b5/0xe3dac0c99afff5b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.747655:0:14310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000237154b5/0xe3dac0c99afff5b5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.747663:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000237154b5/0xe3dac0c99afff5b5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.747694:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841959.747734:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841959.747736:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787841959.748239:0:15007:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787841959.748247:0:15007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000891689c2/0xe3dac0c99afff5bc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.748259:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=499s v=(0 0) 00010000:00010000:0.0:1787841959.748262:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787841959.748267:0:15007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000891689c2/0xe3dac0c99afff5bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.748290:0:15007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000891689c2/0xe3dac0c99afff5bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.748299:0:15007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000891689c2/0xe3dac0c99afff5bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.748307:0:15007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000891689c2/0xe3dac0c99afff5bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.748333:0:15007:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787841959.748345:0:14311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787841959.748350:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000891689c2/0xe3dac0c99afff5bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.748370:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbffa3b800 already unused, calling callback (ffffffffc17a4500) 00010000:00010000:0.0:1787841959.748374:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000891689c2/0xe3dac0c99afff5bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.748383:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000891689c2/0xe3dac0c99afff5bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.748396:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000891689c2/0xe3dac0c99afff5bc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.748403:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000891689c2/0xe3dac0c99afff5bc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.748419:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841959.748421:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841959.748423:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787841959.748823:0:15007:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787841959.748828:0:15007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7800b92/0xe3dac0c99afff5c3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.748834:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=499s v=(0 0) 00010000:00010000:0.0:1787841959.748836:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787841959.748839:0:15007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7800b92/0xe3dac0c99afff5c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.748846:0:15007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d7800b92/0xe3dac0c99afff5c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.748857:0:15007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7800b92/0xe3dac0c99afff5c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.748861:0:15007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d7800b92/0xe3dac0c99afff5c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.748870:0:15007:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787841959.748876:0:14310:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787841959.748880:0:14310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d7800b92/0xe3dac0c99afff5c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.748884:0:14310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbffa3b200 already unused, calling callback (ffffffffc17a4500) 00010000:00010000:0.0:1787841959.748886:0:14310:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7800b92/0xe3dac0c99afff5c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.748891:0:14310:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7800b92/0xe3dac0c99afff5c3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.748901:0:14310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d7800b92/0xe3dac0c99afff5c3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.748908:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d7800b92/0xe3dac0c99afff5c3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.748921:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841959.748928:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841959.748930:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787841959.764561:0:15007:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787841959.764577:0:15007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f112014f/0xe3dac0c99afff5ca lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.764596:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=499s v=(0 0) 00010000:00010000:0.0:1787841959.764601:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787841959.764607:0:15007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f112014f/0xe3dac0c99afff5ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.764621:0:15007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f112014f/0xe3dac0c99afff5ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.764630:0:15007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f112014f/0xe3dac0c99afff5ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.764636:0:15007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f112014f/0xe3dac0c99afff5ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.764656:0:15007:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787841959.764677:0:14311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787841959.764682:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f112014f/0xe3dac0c99afff5ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.764687:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbffa3aa00 already unused, calling callback (ffffffffc17a4500) 00010000:00010000:0.0:1787841959.764691:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f112014f/0xe3dac0c99afff5ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.764746:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f112014f/0xe3dac0c99afff5ca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.764764:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f112014f/0xe3dac0c99afff5ca lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.764770:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f112014f/0xe3dac0c99afff5ca lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.764794:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841959.764795:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841959.764796:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787841959.765549:0:15007:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787841959.765555:0:15007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005470a354/0xe3dac0c99afff5d1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.765566:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=499s v=(0 0) 00010000:00010000:0.0:1787841959.765570:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787841959.765573:0:15007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005470a354/0xe3dac0c99afff5d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.765582:0:15007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005470a354/0xe3dac0c99afff5d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.765589:0:15007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005470a354/0xe3dac0c99afff5d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.765600:0:15007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005470a354/0xe3dac0c99afff5d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.765618:0:15007:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787841959.765630:0:14310:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787841959.765634:0:14310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005470a354/0xe3dac0c99afff5d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.765639:0:14310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6724000 already unused, calling callback (ffffffffc17a4500) 00010000:00010000:0.0:1787841959.765642:0:14310:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005470a354/0xe3dac0c99afff5d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.765647:0:14310:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005470a354/0xe3dac0c99afff5d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.765656:0:14310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005470a354/0xe3dac0c99afff5d1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.765660:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005470a354/0xe3dac0c99afff5d1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.765671:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841959.765672:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841959.765674:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787841959.766095:0:15007:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787841959.766109:0:15007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000843faab2/0xe3dac0c99afff5d8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.766119:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=499s v=(0 0) 00010000:00010000:0.0:1787841959.766122:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787841959.766126:0:15007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000843faab2/0xe3dac0c99afff5d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.766136:0:15007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000843faab2/0xe3dac0c99afff5d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.766145:0:15007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000843faab2/0xe3dac0c99afff5d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.766152:0:15007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000843faab2/0xe3dac0c99afff5d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.766167:0:15007:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787841959.766176:0:14311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787841959.766181:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000843faab2/0xe3dac0c99afff5d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.766188:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6725000 already unused, calling callback (ffffffffc17a4500) 00010000:00010000:0.0:1787841959.766191:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000843faab2/0xe3dac0c99afff5d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.766199:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000843faab2/0xe3dac0c99afff5d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.766217:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000843faab2/0xe3dac0c99afff5d8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.766225:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000843faab2/0xe3dac0c99afff5d8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.766238:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841959.766240:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841959.766242:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787841959.766766:0:15007:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787841959.766772:0:15007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eab7892c/0xe3dac0c99afff5df lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.766779:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=499s v=(0 0) 00010000:00010000:0.0:1787841959.766782:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787841959.766786:0:15007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eab7892c/0xe3dac0c99afff5df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.766793:0:15007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eab7892c/0xe3dac0c99afff5df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.766799:0:15007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eab7892c/0xe3dac0c99afff5df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.766804:0:15007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eab7892c/0xe3dac0c99afff5df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.766823:0:15007:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787841959.766832:0:14310:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787841959.766836:0:14310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eab7892c/0xe3dac0c99afff5df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.766842:0:14310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6725e00 already unused, calling callback (ffffffffc17a4500) 00010000:00010000:0.0:1787841959.766844:0:14310:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eab7892c/0xe3dac0c99afff5df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.766849:0:14310:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eab7892c/0xe3dac0c99afff5df lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.766858:0:14310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eab7892c/0xe3dac0c99afff5df lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.766862:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eab7892c/0xe3dac0c99afff5df lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.766871:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841959.766872:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841959.766873:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787841959.775866:0:15007:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787841959.775888:0:15007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000642bb64c/0xe3dac0c99afff5e6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.775915:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=499s v=(0 0) 00010000:00010000:0.0:1787841959.775938:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787841959.775949:0:15007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000642bb64c/0xe3dac0c99afff5e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.775973:0:15007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000642bb64c/0xe3dac0c99afff5e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.775986:0:15007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000642bb64c/0xe3dac0c99afff5e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.775994:0:15007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000642bb64c/0xe3dac0c99afff5e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.776024:0:15007:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787841959.776367:0:14311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787841959.776377:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000642bb64c/0xe3dac0c99afff5e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.776388:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6724e00 already unused, calling callback (ffffffffc17a4500) 00010000:00010000:0.0:1787841959.776393:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000642bb64c/0xe3dac0c99afff5e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.776405:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000642bb64c/0xe3dac0c99afff5e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.776430:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000642bb64c/0xe3dac0c99afff5e6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.776451:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000642bb64c/0xe3dac0c99afff5e6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.776483:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841959.776485:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841959.776487:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787841959.784284:0:15007:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787841959.784304:0:15007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006504d9f7/0xe3dac0c99afff5ed lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.784328:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=499s v=(0 0) 00010000:00010000:0.0:1787841959.784335:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787841959.784344:0:15007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006504d9f7/0xe3dac0c99afff5ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.784362:0:15007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006504d9f7/0xe3dac0c99afff5ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.784375:0:15007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006504d9f7/0xe3dac0c99afff5ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.784383:0:15007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006504d9f7/0xe3dac0c99afff5ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.784409:0:15007:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787841959.784433:0:14310:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787841959.784453:0:14310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006504d9f7/0xe3dac0c99afff5ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.784463:0:14310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6725200 already unused, calling callback (ffffffffc17a4500) 00010000:00010000:0.0:1787841959.784468:0:14310:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006504d9f7/0xe3dac0c99afff5ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.784479:0:14310:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006504d9f7/0xe3dac0c99afff5ed lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.784500:0:14310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006504d9f7/0xe3dac0c99afff5ed lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.784509:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006504d9f7/0xe3dac0c99afff5ed lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.784535:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841959.784537:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841959.784539:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787841959.788096:0:15007:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787841959.788115:0:15007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000061d4f6d3/0xe3dac0c99afff5f4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.788139:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=499s v=(0 0) 00010000:00010000:0.0:1787841959.788145:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787841959.788154:0:15007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000061d4f6d3/0xe3dac0c99afff5f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.788186:0:15007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000061d4f6d3/0xe3dac0c99afff5f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.788201:0:15007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000061d4f6d3/0xe3dac0c99afff5f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.788209:0:15007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000061d4f6d3/0xe3dac0c99afff5f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.788232:0:15007:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787841959.788250:0:14311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787841959.788258:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000061d4f6d3/0xe3dac0c99afff5f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.788267:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6725a00 already unused, calling callback (ffffffffc17a4500) 00002000:00010000:1.0:1787841959.789456:0:15007:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787841959.789468:0:15007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058f74f6e/0xe3dac0c99afff5fb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841959.789484:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=499s v=(0 0) 00010000:00010000:1.0:1787841959.789489:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787841959.789495:0:15007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058f74f6e/0xe3dac0c99afff5fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841959.789511:0:15007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000058f74f6e/0xe3dac0c99afff5fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841959.789523:0:15007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058f74f6e/0xe3dac0c99afff5fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841959.789531:0:15007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000058f74f6e/0xe3dac0c99afff5fb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841959.789558:0:15007:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787841959.790009:0:15007:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787841959.790016:0:15007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060bffcb6/0xe3dac0c99afff602 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841959.790032:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=499s v=(0 0) 00010000:00010000:1.0:1787841959.790035:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787841959.790040:0:15007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060bffcb6/0xe3dac0c99afff602 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841959.790051:0:15007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000060bffcb6/0xe3dac0c99afff602 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841959.790062:0:15007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060bffcb6/0xe3dac0c99afff602 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841959.790070:0:15007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000060bffcb6/0xe3dac0c99afff602 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841959.790079:0:15007:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1787841959.790505:0:15007:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787841959.790512:0:15007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b8c2380/0xe3dac0c99afff609 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841959.790522:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=499s v=(0 0) 00010000:00010000:1.0:1787841959.790526:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787841959.790531:0:15007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b8c2380/0xe3dac0c99afff609 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841959.790540:0:15007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b8c2380/0xe3dac0c99afff609 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841959.790560:0:15007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b8c2380/0xe3dac0c99afff609 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841959.790567:0:15007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009b8c2380/0xe3dac0c99afff609 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841959.790575:0:15007:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1787841959.791032:0:15007:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787841959.791039:0:15007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef46292d/0xe3dac0c99afff610 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841959.791049:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=499s v=(0 0) 00010000:00010000:1.0:1787841959.791053:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787841959.791056:0:15007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef46292d/0xe3dac0c99afff610 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841959.791066:0:15007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ef46292d/0xe3dac0c99afff610 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841959.791075:0:15007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef46292d/0xe3dac0c99afff610 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841959.791083:0:15007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ef46292d/0xe3dac0c99afff610 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841959.791104:0:15007:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1787841959.791585:0:15007:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787841959.791593:0:15007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a45d1b5/0xe3dac0c99afff617 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841959.791604:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=499s v=(0 0) 00010000:00010000:1.0:1787841959.791607:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787841959.791611:0:15007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008a45d1b5/0xe3dac0c99afff617 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841959.791621:0:15007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008a45d1b5/0xe3dac0c99afff617 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841959.791630:0:15007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a45d1b5/0xe3dac0c99afff617 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841959.791638:0:15007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008a45d1b5/0xe3dac0c99afff617 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841959.791647:0:15007:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:1.0:1787841959.792087:0:15007:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787841959.792094:0:15007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b8fce1dd/0xe3dac0c99afff61e lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841959.792103:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=499s v=(0 0) 00010000:00010000:1.0:1787841959.792113:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787841959.792117:0:15007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b8fce1dd/0xe3dac0c99afff61e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841959.792128:0:15007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b8fce1dd/0xe3dac0c99afff61e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841959.792137:0:15007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b8fce1dd/0xe3dac0c99afff61e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841959.792144:0:15007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b8fce1dd/0xe3dac0c99afff61e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841959.792153:0:15007:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:0.0:1787841959.793548:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000061d4f6d3/0xe3dac0c99afff5f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.793569:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000061d4f6d3/0xe3dac0c99afff5f4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.793596:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000061d4f6d3/0xe3dac0c99afff5f4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.793604:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000061d4f6d3/0xe3dac0c99afff5f4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.793650:0:14311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1787841959.793656:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000058f74f6e/0xe3dac0c99afff5fb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.793665:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cac3331e00 already unused, calling callback (ffffffffc17a4500) 00010000:00010000:0.0:1787841959.793668:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000058f74f6e/0xe3dac0c99afff5fb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.793687:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000058f74f6e/0xe3dac0c99afff5fb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.793716:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000058f74f6e/0xe3dac0c99afff5fb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.793724:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000058f74f6e/0xe3dac0c99afff5fb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.793738:0:14311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1787841959.793743:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000060bffcb6/0xe3dac0c99afff602 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.793750:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cac3330400 already unused, calling callback (ffffffffc17a4500) 00010000:00010000:0.0:1787841959.793753:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000060bffcb6/0xe3dac0c99afff602 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.793773:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000060bffcb6/0xe3dac0c99afff602 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.793784:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000060bffcb6/0xe3dac0c99afff602 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.793792:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060bffcb6/0xe3dac0c99afff602 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.793805:0:14311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1787841959.793809:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009b8c2380/0xe3dac0c99afff609 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.793816:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cac3330600 already unused, calling callback (ffffffffc17a4500) 00010000:00010000:0.0:1787841959.793819:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009b8c2380/0xe3dac0c99afff609 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.793826:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009b8c2380/0xe3dac0c99afff609 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.793836:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009b8c2380/0xe3dac0c99afff609 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.793844:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b8c2380/0xe3dac0c99afff609 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.793868:0:14311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787841959.793872:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ef46292d/0xe3dac0c99afff610 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.793880:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cac3331400 already unused, calling callback (ffffffffc17a4500) 00010000:00010000:0.0:1787841959.793883:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef46292d/0xe3dac0c99afff610 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.793891:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef46292d/0xe3dac0c99afff610 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.793902:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ef46292d/0xe3dac0c99afff610 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.793909:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef46292d/0xe3dac0c99afff610 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.793922:0:14311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787841959.793926:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008a45d1b5/0xe3dac0c99afff617 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.793932:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cac3331600 already unused, calling callback (ffffffffc17a4500) 00010000:00010000:0.0:1787841959.793936:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008a45d1b5/0xe3dac0c99afff617 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.793955:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008a45d1b5/0xe3dac0c99afff617 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.793967:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008a45d1b5/0xe3dac0c99afff617 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.793975:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008a45d1b5/0xe3dac0c99afff617 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.793989:0:14311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787841959.793993:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b8fce1dd/0xe3dac0c99afff61e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.794000:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cac3330000 already unused, calling callback (ffffffffc17a4500) 00010000:00010000:0.0:1787841959.794004:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8fce1dd/0xe3dac0c99afff61e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.794012:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8fce1dd/0xe3dac0c99afff61e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.794022:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b8fce1dd/0xe3dac0c99afff61e lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.794030:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b8fce1dd/0xe3dac0c99afff61e lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.794066:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841959.794069:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841959.794072:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841959.794089:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787841959.806535:0:15007:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787841959.806555:0:15007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d69cdb37/0xe3dac0c99afff625 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841959.806580:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=499s v=(0 0) 00010000:00010000:1.0:1787841959.806586:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787841959.806595:0:15007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d69cdb37/0xe3dac0c99afff625 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841959.806615:0:15007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d69cdb37/0xe3dac0c99afff625 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841959.806627:0:15007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d69cdb37/0xe3dac0c99afff625 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841959.806644:0:15007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d69cdb37/0xe3dac0c99afff625 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841959.806671:0:15007:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787841959.807258:0:15007:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787841959.807265:0:15007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e46ea2b1/0xe3dac0c99afff62c lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841959.807302:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=499s v=(0 0) 00010000:00010000:1.0:1787841959.807306:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787841959.807327:0:15007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e46ea2b1/0xe3dac0c99afff62c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841959.807339:0:15007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e46ea2b1/0xe3dac0c99afff62c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841959.807356:0:15007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e46ea2b1/0xe3dac0c99afff62c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841959.807387:0:15007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e46ea2b1/0xe3dac0c99afff62c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841959.807430:0:15007:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1787841959.808211:0:15007:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787841959.808219:0:15007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b36cf69/0xe3dac0c99afff633 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841959.808239:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=499s v=(0 0) 00010000:00010000:1.0:1787841959.808244:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787841959.808249:0:15007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b36cf69/0xe3dac0c99afff633 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841959.808261:0:15007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b36cf69/0xe3dac0c99afff633 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841959.808307:0:15007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b36cf69/0xe3dac0c99afff633 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841959.808315:0:15007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006b36cf69/0xe3dac0c99afff633 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841959.808325:0:15007:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1787841959.809252:0:15007:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787841959.809262:0:15007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000288adafc/0xe3dac0c99afff63a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.809515:0:14311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787841959.809525:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d69cdb37/0xe3dac0c99afff625 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.809537:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cac3331200 already unused, calling callback (ffffffffc17a4500) 00010000:00010000:0.0:1787841959.809543:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d69cdb37/0xe3dac0c99afff625 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.809555:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d69cdb37/0xe3dac0c99afff625 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.809580:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d69cdb37/0xe3dac0c99afff625 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.809588:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d69cdb37/0xe3dac0c99afff625 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.809612:0:14311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787841959.809616:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e46ea2b1/0xe3dac0c99afff62c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.809623:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cac3331c00 already unused, calling callback (ffffffffc17a4500) 00010000:00010000:0.0:1787841959.809636:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e46ea2b1/0xe3dac0c99afff62c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.809644:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e46ea2b1/0xe3dac0c99afff62c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.809655:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e46ea2b1/0xe3dac0c99afff62c lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.809664:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e46ea2b1/0xe3dac0c99afff62c lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.809677:0:14311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787841959.809681:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006b36cf69/0xe3dac0c99afff633 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.809688:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cac3331000 already unused, calling callback (ffffffffc17a4500) 00010000:00010000:0.0:1787841959.809692:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006b36cf69/0xe3dac0c99afff633 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.809725:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006b36cf69/0xe3dac0c99afff633 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.809735:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006b36cf69/0xe3dac0c99afff633 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.809743:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b36cf69/0xe3dac0c99afff633 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.809764:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841959.809766:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841959.809768:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841959.809963:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787841959.815655:0:5860:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:1.0:1787841959.816927:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=499s v=(0 0) 00010000:00010000:1.0:1787841959.816934:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787841959.816945:0:15007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000288adafc/0xe3dac0c99afff63a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841959.816971:0:15007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000288adafc/0xe3dac0c99afff63a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841959.817002:0:15007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000288adafc/0xe3dac0c99afff63a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841959.817563:0:15007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000288adafc/0xe3dac0c99afff63a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841959.817645:0:15007:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787841959.822006:0:15007:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787841959.822025:0:15007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a17bba1/0xe3dac0c99afff641 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841959.822050:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=499s v=(0 0) 00010000:00010000:1.0:1787841959.822056:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787841959.826511:0:15007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a17bba1/0xe3dac0c99afff641 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841959.826554:0:15007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a17bba1/0xe3dac0c99afff641 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841959.826570:0:15007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a17bba1/0xe3dac0c99afff641 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841959.826580:0:15007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000a17bba1/0xe3dac0c99afff641 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.826733:0:14311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787841959.826745:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000288adafc/0xe3dac0c99afff63a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.826755:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cac3330a00 already unused, calling callback (ffffffffc17a4500) 00010000:00010000:0.0:1787841959.826761:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000288adafc/0xe3dac0c99afff63a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.826770:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000288adafc/0xe3dac0c99afff63a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.826791:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000288adafc/0xe3dac0c99afff63a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.826798:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000288adafc/0xe3dac0c99afff63a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.826831:0:14311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787841959.826835:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000a17bba1/0xe3dac0c99afff641 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.826841:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cac3331800 already unused, calling callback (ffffffffc17a4500) 00010000:00010000:0.0:1787841959.826851:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000a17bba1/0xe3dac0c99afff641 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.826859:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000a17bba1/0xe3dac0c99afff641 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.826870:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000a17bba1/0xe3dac0c99afff641 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.826878:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841959.826880:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841959.826882:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841959.829747:0:15007:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787841959.829771:0:15007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a17bba1/0xe3dac0c99afff641 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787841959.830902:0:15007:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787841959.830916:0:15007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb62d2df/0xe3dac0c99afff648 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841959.830937:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=499s v=(0 0) 00010000:00010000:1.0:1787841959.830942:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787841959.830949:0:15007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb62d2df/0xe3dac0c99afff648 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841959.830965:0:15007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cb62d2df/0xe3dac0c99afff648 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841959.830977:0:15007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb62d2df/0xe3dac0c99afff648 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841959.830987:0:15007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cb62d2df/0xe3dac0c99afff648 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.833688:0:14310:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787841959.833726:0:14310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cb62d2df/0xe3dac0c99afff648 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.833743:0:14310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cac3331a00 already unused, calling callback (ffffffffc17a4500) 00010000:00010000:0.0:1787841959.833750:0:14310:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb62d2df/0xe3dac0c99afff648 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.833764:0:14310:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb62d2df/0xe3dac0c99afff648 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.833791:0:14310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cb62d2df/0xe3dac0c99afff648 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.833803:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841959.833813:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841959.833816:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841959.834487:0:15007:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787841959.834501:0:15007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb62d2df/0xe3dac0c99afff648 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841959.835199:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1787841959.836264:0:15007:0:(ofd_dev.c:1521:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:1.0:1787841959.836439:0:15007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac26de940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14347:x1874687715024640:12345-0@lo:5:osp-pre-1-0.0 Request processed in 145211us (145786us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841959.836453:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787841959.836638:0:14347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac26dcf00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14347:1874687715024640:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1787841959.836661:0:14347:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:0.0:1787841959.836757:0:14347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac26dcf00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14347:1874687715024768:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1787841959.836806:0:14347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841959.836870:0:14347:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbe9984840 going to sleep for 11 seconds 00000100:00100000:2.0:1787841959.837202:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715024768 00000100:00100000:2.0:1787841959.837211:0:15006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715024768 00000100:00100000:2.0:1787841959.837293:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787841959.837305:0:15006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac26de580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14347:x1874687715024768:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1787841959.837366:0:15006:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:2.0:1787841959.851954:0:15006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac26de580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14347:x1874687715024768:12345-0@lo:5:osp-pre-1-0.0 Request processed in 14636us (15132us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1787841959.851974:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787841959.854435:0:14347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac26dcf00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14347:1874687715024768:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1787841959.854462:0:14347:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000001:00080000:2.0:1787841960.366484:0:7643:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:2.0:1787841960.366505:0:7643:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1787841960.581409:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787841961.602007:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841962.625014:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787841962.754018:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787841962.757201:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687715024896:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787841962.760576:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841962.762385:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715024896 00000100:00100000:0.0:1787841962.762402:0:15008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715024896 00000100:00100000:0.0:1787841962.762497:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787841962.762511:0:15008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac3091a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874687715024896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787841962.762567:0:15008:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787841962.762673:0:15008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac3091a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874687715024896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 167us (2110us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841962.762682:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787841962.762770:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687715024896:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787841962.763311:0:14318:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1787841963.139556:0:14354:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:3.0:1787841963.288746:0:16082:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg101-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787841963.665590:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787841964.673930:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787841964.801379:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4bb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687715025280:0@lo:400:kworker.0 00000100:00100000:2.0:1787841964.801486:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841964.801564:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787841964.801572:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4bb0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874687715025408:0@lo:400:kworker.0 00000100:00100000:2.0:1787841964.801604:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841964.801649:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715025408 00000100:00100000:2.0:1787841964.801659:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715025408 00000100:00100000:2.0:1787841964.801764:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787841964.801775:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbd4bb03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874687715025408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787841964.801889:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4bb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:3300:1874687715025024:0@lo:400:kworker.0 00000100:00100000:3.0:1787841964.801936:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841964.801975:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4bb1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1874687715025536:0@lo:400:kworker.0 00000100:00100000:3.0:1787841964.802008:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841964.802028:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787841964.802034:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4bb2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874687715025152:0@lo:400:kworker.0 00000100:00100000:3.0:1787841964.802058:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841964.802080:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbd4bb0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1874687715025664:0@lo:400:kworker.0 00000100:00100000:3.0:1787841964.802127:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841964.802151:0:15005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715025280 00000100:00100000:3.0:1787841964.802157:0:15005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715025280 00000100:00100000:3.0:1787841964.802212:0:15005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715025152 00000100:00100000:3.0:1787841964.802215:0:15005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715025152 00000100:00100000:3.0:1787841964.802235:0:15005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787841964.802244:0:15005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbd4bb21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1874687715025280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787841964.802281:0:15005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbd4bb21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1874687715025280:12345-0@lo:400:kworker.0 Request processed in 39us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841964.802289:0:15005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787841964.802310:0:15005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787841964.802316:0:15005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac3093840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1874687715025152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787841964.802353:0:15005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac3093840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1874687715025152:12345-0@lo:400:kworker.0 Request processed in 37us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841964.802358:0:15005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787841964.802398:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4bb2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874687715025152:0@lo:400:kworker.0 00000100:00100000:2.0:1787841964.802530:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbd4bb03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874687715025408:12345-0@lo:400:kworker.0 Request processed in 755us (924us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841964.802537:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787841964.802552:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715025536 00000100:00100000:2.0:1787841964.802555:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715025536 00000100:00100000:2.0:1787841964.802573:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715025664 00000100:00100000:2.0:1787841964.802576:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715025664 00000100:00100000:2.0:1787841964.802590:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787841964.802595:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac3093c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874687715025536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841964.802644:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac3093c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874687715025536:12345-0@lo:400:kworker.0 Request processed in 47us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841964.802649:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787841964.802661:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787841964.802678:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac3091e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874687715025664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841964.802746:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac3091e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874687715025664:12345-0@lo:400:kworker.0 Request processed in 70us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841964.802753:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787841964.802781:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715025024 00000100:00100000:2.0:1787841964.802784:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715025024 00000100:00100000:2.0:1787841964.802810:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787841964.802816:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe76e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+19:3300:x1874687715025024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841964.802848:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe76e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+19:3300:x1874687715025024:12345-0@lo:400:kworker.0 Request processed in 32us (912us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841964.802855:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:2.0:1787841964.802888:0:14318:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787841964.802894:0:14318:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787841964.802897:0:14318:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787841964.802930:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbd4bb0780 x1874687715025408/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787841980 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787841964.802943:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4bb0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874687715025408:0@lo:400:kworker.0 00000100:00100000:2.0:1787841964.802955:0:3298:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1787841964.803120:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4bb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687715025280:0@lo:400:kworker.0 00010000:00080000:3.0:1787841964.803299:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbd4bb0b40 x1874687715025664/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787841980 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787841964.803312:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4bb0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1874687715025664:0@lo:400:kworker.0 00000100:00100000:3.0:1787841964.803323:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4bb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:3300:1874687715025024:0@lo:400:kworker.0 00010000:00080000:3.0:1787841964.803333:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92cbd4bb1680 x1874687715025536/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787841980 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787841964.803341:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbd4bb1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1874687715025536:0@lo:400:kworker.0 00000100:00100000:1.0:1787841964.820883:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787841964.820940:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874687715025792:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787841964.821074:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841964.825539:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715025792 00000100:00100000:2.0:1787841964.825561:0:15008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715025792 00000100:00100000:2.0:1787841964.825658:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787841964.825672:0:15008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e2f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874687715025792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787841964.825761:0:15008:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787841964.825884:0:15008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e2f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874687715025792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 215us (4809us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841964.825904:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787841964.827788:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874687715025792:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787841965.699164:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787841966.065647:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841966.066055:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695104256 00000100:00100000:2.0:1787841966.066076:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695104256 00000100:00100000:2.0:1787841966.066486:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 77 00000100:00100000:2.0:1787841966.066498:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6ff5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2353:x1874687695104256:12345-192.168.201.1@tcp:250:mount.lustre.0 00010000:00080000:2.0:1787841966.066531:0:14315:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from 34e5681c-63ea-4fb9-89c0-59dcf324dc9b@192.168.201.1@tcp t0 exp 0000000000000000 cur 506 last 0 00000020:00000080:2.0:1787841966.066565:0:14315:0:(genops.c:1385:class_connect()) connect: client 34e5681c-63ea-4fb9-89c0-59dcf324dc9b, cookie 0xe3dac0c99afff64f 00000100:00080000:2.0:1787841966.066734:0:14315:0:(import.c:65:import_set_state_nolock()) ffff92cbf07da000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787841966.067053:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6ff5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34e5681c-63ea-4fb9-89c0-59dcf324dc9b+5:2353:x1874687695104256:12345-192.168.201.1@tcp:250:mount.lustre.0 Request processed in 554us (1415us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841966.067073:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 77 00000100:00100000:1.0:1787841966.104466:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841966.109520:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695104384 00000100:00100000:2.0:1787841966.109536:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695104384 00000100:00100000:2.0:1787841966.109601:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 78 00000100:00100000:2.0:1787841966.109612:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6ff5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34e5681c-63ea-4fb9-89c0-59dcf324dc9b+5:13753:x1874687695104384:12345-192.168.201.1@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787841966.109628:0:14316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841966.109647:0:14316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92cbc6105000/0xe3dac0c99afff656 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6b8c expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841966.109678:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92cbc6105000/0xe3dac0c99afff656 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b8c expref: 6 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841966.109688:0:14316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92cbc6105000/0xe3dac0c99afff656 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b8c expref: 6 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841966.109725:0:14316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc6105000, rc 0) 00000100:00100000:2.0:1787841966.109806:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6ff5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34e5681c-63ea-4fb9-89c0-59dcf324dc9b+6:13753:x1874687695104384:12345-192.168.201.1@tcp:101:mount.lustre.0 Request processed in 197us (5354us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841966.109814:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 78 00000100:00100000:3.0:1787841966.112027:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841966.112575:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695104512 00000100:00100000:1.0:1787841966.112587:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695104512 00000100:00100000:1.0:1787841966.112651:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 79 00000100:00100000:1.0:1787841966.112661:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6ff6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34e5681c-63ea-4fb9-89c0-59dcf324dc9b+6:13753:x1874687695104512:12345-192.168.201.1@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787841966.112970:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6ff6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34e5681c-63ea-4fb9-89c0-59dcf324dc9b+6:13753:x1874687695104512:12345-192.168.201.1@tcp:501:mount.lustre.0 Request processed in 310us (953us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787841966.112978:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 79 00000100:00100000:1.0:1787841966.117454:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841966.118341:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695104640 00000100:00100000:0.0:1787841966.118353:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695104640 00000100:00100000:0.0:1787841966.118417:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 80 00000100:00100000:0.0:1787841966.118427:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6ff4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34e5681c-63ea-4fb9-89c0-59dcf324dc9b+6:13753:x1874687695104640:12345-192.168.201.1@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787841966.118444:0:14317:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841966.118475:0:14317:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92cbc6725c00/0xe3dac0c99afff65d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6b93 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841966.118506:0:14317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92cbc6725c00/0xe3dac0c99afff65d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b93 expref: 7 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841966.118517:0:14317:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92cbc6725c00/0xe3dac0c99afff65d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6b93 expref: 7 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841966.118526:0:14317:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc6725c00, rc 0) 00000100:00100000:0.0:1787841966.118595:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6ff4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34e5681c-63ea-4fb9-89c0-59dcf324dc9b+7:13753:x1874687695104640:12345-192.168.201.1@tcp:101:mount.lustre.0 Request processed in 170us (1155us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841966.118604:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 80 00000100:00100000:3.0:1787841966.126777:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841966.128023:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695104768 00000100:00100000:2.0:1787841966.128037:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695104768 00000100:00100000:2.0:1787841966.128108:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 81 00000100:00100000:2.0:1787841966.128119:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6ff4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34e5681c-63ea-4fb9-89c0-59dcf324dc9b+7:13753:x1874687695104768:12345-192.168.201.1@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787841966.128479:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6ff4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34e5681c-63ea-4fb9-89c0-59dcf324dc9b+8:13753:x1874687695104768:12345-192.168.201.1@tcp:501:mount.lustre.0 Request processed in 360us (1713us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841966.128487:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 81 00000100:00100000:3.0:1787841966.135204:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841966.135280:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695104896 00000100:00100000:1.0:1787841966.135292:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695104896 00000100:00100000:1.0:1787841966.135354:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 82 00000100:00100000:1.0:1787841966.135364:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6ff4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34e5681c-63ea-4fb9-89c0-59dcf324dc9b+8:13753:x1874687695104896:12345-192.168.201.1@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787841966.135617:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6ff4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34e5681c-63ea-4fb9-89c0-59dcf324dc9b+8:13753:x1874687695104896:12345-192.168.201.1@tcp:503:mount.lustre.0 Request processed in 254us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841966.135627:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 82 00000100:00100000:1.0:1787841966.148229:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841966.148754:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695105024 00000100:00100000:0.0:1787841966.148765:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695105024 00000100:00100000:0.0:1787841966.148817:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 83 00000100:00100000:0.0:1787841966.148828:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6ff7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34e5681c-63ea-4fb9-89c0-59dcf324dc9b+8:13771:x1874687695105024:12345-192.168.201.1@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787841966.149136:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6ff7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34e5681c-63ea-4fb9-89c0-59dcf324dc9b+8:13771:x1874687695105024:12345-192.168.201.1@tcp:502:llog_process_th.0 Request processed in 310us (917us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841966.149145:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 83 00000100:00100000:3.0:1787841966.215151:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841966.215285:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695105152 00000100:00100000:2.0:1787841966.215295:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695105152 00000100:00100000:2.0:1787841966.215353:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 84 00000100:00100000:2.0:1787841966.215362:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6ff4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34e5681c-63ea-4fb9-89c0-59dcf324dc9b+8:13771:x1874687695105152:12345-192.168.201.1@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787841966.215636:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6ff4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34e5681c-63ea-4fb9-89c0-59dcf324dc9b+8:13771:x1874687695105152:12345-192.168.201.1@tcp:502:llog_process_th.0 Request processed in 274us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841966.215643:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 84 00000100:00100000:3.0:1787841966.230577:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841966.232430:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695105280 00000100:00100000:1.0:1787841966.232444:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695105280 00000100:00100000:1.0:1787841966.232514:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 85 00000100:00100000:1.0:1787841966.232524:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6ff5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34e5681c-63ea-4fb9-89c0-59dcf324dc9b+8:13753:x1874687695105280:12345-192.168.201.1@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787841966.232542:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841966.232563:0:14315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92cac3331800/0xe3dac0c99afff664 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6bbd expref: -99 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841966.232596:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92cac3331800/0xe3dac0c99afff664 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6bbd expref: 9 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841966.232609:0:14315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92cac3331800/0xe3dac0c99afff664 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6bbd expref: 9 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841966.232619:0:14315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cac3331800, rc 0) 00000100:00100000:1.0:1787841966.232687:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6ff5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34e5681c-63ea-4fb9-89c0-59dcf324dc9b+9:13753:x1874687695105280:12345-192.168.201.1@tcp:101:mount.lustre.0 Request processed in 164us (2120us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841966.232695:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 85 00000100:00100000:1.0:1787841966.242966:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841966.243071:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695105408 00000100:00100000:0.0:1787841966.243081:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695105408 00000100:00100000:0.0:1787841966.243148:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 86 00000100:00100000:0.0:1787841966.243167:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6ff6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34e5681c-63ea-4fb9-89c0-59dcf324dc9b+9:13753:x1874687695105408:12345-192.168.201.1@tcp:256:mount.lustre.0 20000000:01000000:0.0:1787841966.243194:0:14317:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787841966.243217:0:14317:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787841966.243222:0:14317:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787841966.243225:0:14317:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787841966.243243:0:14317:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1787841966.245465:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6ff6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34e5681c-63ea-4fb9-89c0-59dcf324dc9b+9:13753:x1874687695105408:12345-192.168.201.1@tcp:256:mount.lustre.0 Request processed in 2298us (2502us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841966.245478:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 86 00000100:00100000:3.0:1787841966.251870:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841966.251994:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695105536 00000100:00100000:2.0:1787841966.252006:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695105536 00000100:00100000:2.0:1787841966.252065:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 87 00000100:00100000:2.0:1787841966.252075:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6ff6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34e5681c-63ea-4fb9-89c0-59dcf324dc9b+9:13753:x1874687695105536:12345-192.168.201.1@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787841966.252101:0:14316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841966.252119:0:14316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92cbc6104200/0xe3dac0c99afff66b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6bc4 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841966.252152:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92cbc6104200/0xe3dac0c99afff66b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6bc4 expref: 10 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841966.252187:0:14316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92cbc6104200/0xe3dac0c99afff66b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6bc4 expref: 10 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841966.252197:0:14316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc6104200, rc 0) 00000100:00100000:2.0:1787841966.252266:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6ff6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34e5681c-63ea-4fb9-89c0-59dcf324dc9b+10:13753:x1874687695105536:12345-192.168.201.1@tcp:101:mount.lustre.0 Request processed in 192us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841966.252273:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 87 00000100:00100000:1.0:1787841966.254474:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841966.254630:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695105664 00000100:00100000:0.0:1787841966.254640:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695105664 00000100:00100000:0.0:1787841966.254724:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 88 00000100:00100000:0.0:1787841966.254735:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6ff7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34e5681c-63ea-4fb9-89c0-59dcf324dc9b+10:13753:x1874687695105664:12345-192.168.201.1@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787841966.255037:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6ff7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34e5681c-63ea-4fb9-89c0-59dcf324dc9b+10:13753:x1874687695105664:12345-192.168.201.1@tcp:501:mount.lustre.0 Request processed in 303us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841966.255045:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 88 00000100:00100000:3.0:1787841966.258833:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841966.258965:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695105792 00000100:00100000:1.0:1787841966.258975:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695105792 00000100:00100000:1.0:1787841966.259034:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 89 00000100:00100000:1.0:1787841966.259059:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf8eb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34e5681c-63ea-4fb9-89c0-59dcf324dc9b+10:13753:x1874687695105792:12345-192.168.201.1@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787841966.259356:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf8eb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34e5681c-63ea-4fb9-89c0-59dcf324dc9b+10:13753:x1874687695105792:12345-192.168.201.1@tcp:503:mount.lustre.0 Request processed in 297us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841966.259365:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 89 00000100:00100000:3.0:1787841966.264827:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841966.265771:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695105920 00000100:00100000:2.0:1787841966.265783:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695105920 00000100:00100000:2.0:1787841966.265847:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 90 00000100:00100000:2.0:1787841966.265857:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf8eb7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34e5681c-63ea-4fb9-89c0-59dcf324dc9b+10:13776:x1874687695105920:12345-192.168.201.1@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787841966.266117:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf8eb7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34e5681c-63ea-4fb9-89c0-59dcf324dc9b+10:13776:x1874687695105920:12345-192.168.201.1@tcp:502:llog_process_th.0 Request processed in 261us (1301us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841966.266126:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 90 00000100:00100000:2.0:1787841966.273272:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841966.273525:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695106048 00000100:00100000:0.0:1787841966.273537:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695106048 00000100:00100000:0.0:1787841966.273597:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 91 00000100:00100000:0.0:1787841966.273607:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf8eb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34e5681c-63ea-4fb9-89c0-59dcf324dc9b+10:13776:x1874687695106048:12345-192.168.201.1@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787841966.273896:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf8eb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34e5681c-63ea-4fb9-89c0-59dcf324dc9b+10:13776:x1874687695106048:12345-192.168.201.1@tcp:502:llog_process_th.0 Request processed in 290us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841966.273905:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 91 00000100:00100000:3.0:1787841966.279213:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841966.279454:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695106176 00000100:00100000:2.0:1787841966.279467:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695106176 00000100:00100000:2.0:1787841966.279527:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 4 00000100:00100000:2.0:1787841966.279537:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac3091680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2353:x1874687695106176:12345-192.168.201.1@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787841966.279568:0:14322:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from d29cd7d6-5033-4a84-a074-c74886c050cd@192.168.201.1@tcp t0 exp 0000000000000000 cur 506 last 0 00000020:00000080:2.0:1787841966.279623:0:14322:0:(genops.c:1385:class_connect()) connect: client d29cd7d6-5033-4a84-a074-c74886c050cd, cookie 0xe3dac0c99afff672 00000004:00100000:2.0:1787841966.279653:0:14322:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1787841966.279659:0:14322:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:2.0:1787841966.358667:0:14322:0:(import.c:65:import_set_state_nolock()) ffff92cbf07de000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787841966.358793:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac3091680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d29cd7d6-5033-4a84-a074-c74886c050cd+6:2353:x1874687695106176:12345-192.168.201.1@tcp:38:mount.lustre.0 Request processed in 79254us (79592us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841966.358817:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 4 00000100:00100000:3.0:1787841966.366886:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841966.366994:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695106304 00000100:00100000:2.0:1787841966.367003:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695106304 00000100:00100000:2.0:1787841966.368361:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 5 00000100:00100000:2.0:1787841966.368375:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac30930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d29cd7d6-5033-4a84-a074-c74886c050cd+6:0:x1874687695106304:12345-192.168.201.1@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787841966.368419:0:14323:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787841966.368512:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac30930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d29cd7d6-5033-4a84-a074-c74886c050cd+6:0:x1874687695106304:12345-192.168.201.1@tcp:41:mount.lustre.0 Request processed in 141us (1638us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841966.368520:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 5 00000100:00080000:3.0:1787841966.371715:0:14318:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787841966.374296:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841966.378252:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695106432 00000100:00100000:0.0:1787841966.378267:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695106432 00000100:00100000:2.0:1787841966.381268:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 6 00000100:00100000:2.0:1787841966.381285:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbd4bb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d29cd7d6-5033-4a84-a074-c74886c050cd+6:13753:x1874687695106432:12345-192.168.201.1@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787841966.381318:0:14322:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787841966.381400:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbd4bb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d29cd7d6-5033-4a84-a074-c74886c050cd+6:13753:x1874687695106432:12345-192.168.201.1@tcp:41:mount.lustre.0 Request processed in 120us (7114us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841966.381408:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 6 00000100:00100000:3.0:1787841966.385130:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841966.385333:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695106560 00000100:00100000:1.0:1787841966.385343:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695106560 00000100:00100000:1.0:1787841966.385393:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 7 00000100:00100000:1.0:1787841966.385403:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac3090b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d29cd7d6-5033-4a84-a074-c74886c050cd+6:13753:x1874687695106560:12345-192.168.201.1@tcp:40:mount.lustre.0 00000100:00100000:1.0:1787841966.385516:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac3090b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d29cd7d6-5033-4a84-a074-c74886c050cd+6:13753:x1874687695106560:12345-192.168.201.1@tcp:40:mount.lustre.0 Request processed in 114us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841966.385524:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 7 00000100:00100000:3.0:1787841966.389297:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841966.393606:0:15005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695106688 00000100:00100000:0.0:1787841966.393629:0:15005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695106688 00000100:00100000:0.0:1787841966.393711:0:15005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 9 00000100:00100000:0.0:1787841966.393723:0:15005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac3092940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2353:x1874687695106688:12345-192.168.201.1@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787841966.393761:0:15005:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from d29cd7d6-5033-4a84-a074-c74886c050cd@192.168.201.1@tcp t0 exp 0000000000000000 cur 506 last 0 00000020:00000080:0.0:1787841966.393799:0:15005:0:(genops.c:1385:class_connect()) connect: client d29cd7d6-5033-4a84-a074-c74886c050cd, cookie 0xe3dac0c99afff679 00002000:00100000:0.0:1787841966.393826:0:15005:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d29cd7d6-5033-4a84-a074-c74886c050cd/ffff92cac315d000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211395f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787841966.393852:0:15005:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1787841966.394669:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841966.394741:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841966.394787:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695106944 00000100:00100000:3.0:1787841966.394794:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695106944 00000100:00100000:3.0:1787841966.394839:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 0 00000100:00100000:3.0:1787841966.394848:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac30903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d29cd7d6-5033-4a84-a074-c74886c050cd+6:13753:x1874687695106944:12345-192.168.201.1@tcp:33:mount.lustre.0 00000004:00080000:3.0:1787841966.395523:0:14325:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 600us 00000100:00100000:2.0:1787841966.398250:0:15007:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1787841966.398269:0:15007:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00002000:00080000:0.0:1787841966.398802:0:15005:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787841966.398847:0:15005:0:(import.c:65:import_set_state_nolock()) ffff92cac315f000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787841966.398922:0:15005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac3092940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d29cd7d6-5033-4a84-a074-c74886c050cd+6:2353:x1874687695106688:12345-192.168.201.1@tcp:8:mount.lustre.0 Request processed in 5199us (9638us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841966.399288:0:15005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 9 00000100:00100000:0.0:1787841966.399316:0:15005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695106816 00000100:00100000:0.0:1787841966.399324:0:15005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695106816 00000100:00100000:0.0:1787841966.399360:0:15005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 10 00000100:00100000:0.0:1787841966.399366:0:15005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac3092580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2353:x1874687695106816:12345-192.168.201.1@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787841966.399393:0:15005:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from d29cd7d6-5033-4a84-a074-c74886c050cd@192.168.201.1@tcp t0 exp 0000000000000000 cur 506 last 0 00000020:00000080:0.0:1787841966.399418:0:15005:0:(genops.c:1385:class_connect()) connect: client d29cd7d6-5033-4a84-a074-c74886c050cd, cookie 0xe3dac0c99afff680 00002000:00100000:0.0:1787841966.399430:0:15005:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d29cd7d6-5033-4a84-a074-c74886c050cd/ffff92cac315b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211395f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787841966.399452:0:15005:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787841966.399786:0:15005:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787841966.399808:0:15005:0:(import.c:65:import_set_state_nolock()) ffff92cac315a000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787841966.399885:0:15005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac3092580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d29cd7d6-5033-4a84-a074-c74886c050cd+6:2353:x1874687695106816:12345-192.168.201.1@tcp:8:mount.lustre.0 Request processed in 517us (5218us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841966.399893:0:15005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 10 00000004:00200000:0.0:1787841966.435165:0:14325:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:0.0:1787841966.436209:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac30903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d29cd7d6-5033-4a84-a074-c74886c050cd+6:13753:x1874687695106944:12345-192.168.201.1@tcp:33:mount.lustre.0 Request processed in 41353us (41458us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841966.436225:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 0 00000100:00100000:2.0:1787841966.687847:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841966.688221:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695107072 00000100:00100000:1.0:1787841966.688244:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695107072 00000100:00100000:1.0:1787841966.688347:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 8 00000100:00100000:1.0:1787841966.688358:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbd4bb0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d29cd7d6-5033-4a84-a074-c74886c050cd+6:13797:x1874687695107072:12345-192.168.201.1@tcp:101:mkdir.0 00010000:00010000:1.0:1787841966.688381:0:14324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841966.688408:0:14324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3330a00/0xe3dac0c99afff687 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6bee expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841966.688488:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331000/0xe3dac0c99afff68e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841966.688504:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331000/0xe3dac0c99afff68e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841966.688519:0:14324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331000/0xe3dac0c99afff68e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787841966.688793:0:14324:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787841966.688798:0:14324:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1787841966.688903:0:14324:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331000/0xe3dac0c99afff68e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841966.688946:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3330a00/0xe3dac0c99afff687 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6bee expref: 8 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841966.688963:0:14324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331000/0xe3dac0c99afff68e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6bee expref: 7 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841966.688972:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92cbcd829500) 00010000:00010000:1.0:1787841966.688975:0:14324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787841966.688978:0:14324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cac3331000, rc 0) 00000100:00100000:1.0:1787841966.689052:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbd4bb0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d29cd7d6-5033-4a84-a074-c74886c050cd+7:13797:x1874687695107072:12345-192.168.201.1@tcp:101:mkdir.0 Request processed in 696us (1216us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841966.689059:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 8 00010000:00010000:3.0:1787841966.720914:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841967.744921:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787841967.873050:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787841967.873075:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687715025920:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787841967.873158:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841967.873283:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715025920 00000100:00100000:0.0:1787841967.873291:0:15008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715025920 00000100:00100000:0.0:1787841967.873354:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787841967.873364:0:15008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac30912c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874687715025920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787841967.873389:0:15008:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787841967.873443:0:15008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac30912c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874687715025920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841967.873450:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787841967.873495:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687715025920:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787841967.873671:0:14318:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787841968.751844:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841968.751975:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695107200 00000100:00100000:2.0:1787841968.751994:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695107200 00000100:00100000:2.0:1787841968.752168:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 9 00000100:00100000:2.0:1787841968.752180:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac3090f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d29cd7d6-5033-4a84-a074-c74886c050cd+7:13849:x1874687695107200:12345-192.168.201.1@tcp:41:lfs.0 00000004:00000024:2.0:1787841968.752225:0:14323:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787841968.752333:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac3090f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d29cd7d6-5033-4a84-a074-c74886c050cd+7:13849:x1874687695107200:12345-192.168.201.1@tcp:41:lfs.0 Request processed in 155us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841968.752366:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 9 00000100:00080000:3.0:1787841968.755832:0:14318:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787841968.757194:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841968.763507:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695107328 00000100:00100000:0.0:1787841968.763524:0:15008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695107328 00000100:00100000:0.0:1787841968.763628:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 7 00000100:00100000:0.0:1787841968.763641:0:15008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac30921c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d29cd7d6-5033-4a84-a074-c74886c050cd+6:13849:x1874687695107328:12345-192.168.201.1@tcp:13:lfs.0 00002000:00000024:0.0:1787841968.763684:0:15008:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787841968.763804:0:15008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac30921c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d29cd7d6-5033-4a84-a074-c74886c050cd+6:13849:x1874687695107328:12345-192.168.201.1@tcp:13:lfs.0 Request processed in 166us (6620us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841968.763812:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 7 00000100:00080000:3.0:1787841968.763909:0:14318:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787841968.767181:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841968.767287:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695107456 00000100:00100000:0.0:1787841968.767298:0:15008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695107456 00000100:00080000:3.0:1787841968.767510:0:14318:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787841968.767551:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 8 00000100:00100000:0.0:1787841968.767562:0:15008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d29cd7d6-5033-4a84-a074-c74886c050cd+6:13849:x1874687695107456:12345-192.168.201.1@tcp:13:lfs.0 00002000:00000024:0.0:1787841968.767601:0:15008:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787841968.767683:0:15008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d29cd7d6-5033-4a84-a074-c74886c050cd+6:13849:x1874687695107456:12345-192.168.201.1@tcp:13:lfs.0 Request processed in 123us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841968.767692:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 8 00010000:00010000:3.0:1787841968.769791:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787841968.970846:0:6717:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d29cd7d6-5033-4a84-a074-c74886c050cd 00000100:00100000:2.0:1787841969.108936:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841969.109029:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695107584 00000100:00100000:1.0:1787841969.109040:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695107584 00000100:00100000:1.0:1787841969.109100:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 92 00000100:00100000:1.0:1787841969.109151:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf8eb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34e5681c-63ea-4fb9-89c0-59dcf324dc9b+10:13881:x1874687695107584:12345-192.168.201.1@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787841969.109170:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841969.109188:0:14315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92cac3331c00/0xe3dac0c99afff695 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6bf5 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841969.109216:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92cac3331c00/0xe3dac0c99afff695 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6bf5 expref: 11 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841969.109243:0:14315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92cac3331c00/0xe3dac0c99afff695 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6bf5 expref: 11 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841969.109253:0:14315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cac3331c00, rc 0) 00000100:00100000:1.0:1787841969.109313:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf8eb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34e5681c-63ea-4fb9-89c0-59dcf324dc9b+11:13881:x1874687695107584:12345-192.168.201.1@tcp:101:mount.lustre.0 Request processed in 206us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841969.109321:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 92 00000100:00100000:3.0:1787841969.125217:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841969.125574:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695107712 00000100:00100000:2.0:1787841969.125596:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695107712 00000100:00100000:2.0:1787841969.125668:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 93 00000100:00100000:2.0:1787841969.125679:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf8eb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34e5681c-63ea-4fb9-89c0-59dcf324dc9b+11:13881:x1874687695107712:12345-192.168.201.1@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787841969.126201:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf8eb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34e5681c-63ea-4fb9-89c0-59dcf324dc9b+11:13881:x1874687695107712:12345-192.168.201.1@tcp:501:mount.lustre.0 Request processed in 522us (999us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841969.126209:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 93 00000100:00100000:2.0:1787841969.133157:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841969.133269:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695107840 00000100:00100000:0.0:1787841969.133297:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695107840 00000100:00100000:0.0:1787841969.133357:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 94 00000100:00100000:0.0:1787841969.133368:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf8eb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34e5681c-63ea-4fb9-89c0-59dcf324dc9b+11:13881:x1874687695107840:12345-192.168.201.1@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787841969.133617:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf8eb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34e5681c-63ea-4fb9-89c0-59dcf324dc9b+11:13881:x1874687695107840:12345-192.168.201.1@tcp:503:mount.lustre.0 Request processed in 250us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841969.133626:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 94 00000100:00100000:3.0:1787841969.156655:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841969.156889:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695107968 00000100:00100000:1.0:1787841969.156897:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695107968 00000100:00100000:1.0:1787841969.156944:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 95 00000100:00100000:1.0:1787841969.156951:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf8eb5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34e5681c-63ea-4fb9-89c0-59dcf324dc9b+11:13888:x1874687695107968:12345-192.168.201.1@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787841969.157237:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf8eb5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34e5681c-63ea-4fb9-89c0-59dcf324dc9b+11:13888:x1874687695107968:12345-192.168.201.1@tcp:502:llog_process_th.0 Request processed in 284us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841969.157246:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 95 00000100:00100000:3.0:1787841969.168233:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841969.168485:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695108096 00000100:00100000:2.0:1787841969.168496:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695108096 00000100:00100000:2.0:1787841969.168558:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 96 00000100:00100000:2.0:1787841969.168569:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf8eb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34e5681c-63ea-4fb9-89c0-59dcf324dc9b+11:13888:x1874687695108096:12345-192.168.201.1@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787841969.168922:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf8eb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34e5681c-63ea-4fb9-89c0-59dcf324dc9b+11:13888:x1874687695108096:12345-192.168.201.1@tcp:502:llog_process_th.0 Request processed in 354us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841969.168930:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 96 00000100:00100000:2.0:1787841969.178054:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841969.178343:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695108224 00000100:00100000:0.0:1787841969.178356:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695108224 00000100:00100000:0.0:1787841969.178420:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 97 00000100:00100000:0.0:1787841969.178430:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf8eb6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34e5681c-63ea-4fb9-89c0-59dcf324dc9b+11:13881:x1874687695108224:12345-192.168.201.1@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787841969.178450:0:14317:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841969.178471:0:14317:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92cbc6724800/0xe3dac0c99afff69c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6c1f expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841969.178505:0:14317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92cbc6724800/0xe3dac0c99afff69c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6c1f expref: 12 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841969.178516:0:14317:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92cbc6724800/0xe3dac0c99afff69c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6c1f expref: 12 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841969.178525:0:14317:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc6724800, rc 0) 00000100:00100000:0.0:1787841969.178637:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf8eb6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34e5681c-63ea-4fb9-89c0-59dcf324dc9b+12:13881:x1874687695108224:12345-192.168.201.1@tcp:101:mount.lustre.0 Request processed in 207us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841969.178645:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 97 00000100:00100000:0.0:1787841969.197442:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841969.197569:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695108352 00000100:00100000:1.0:1787841969.197583:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695108352 00000100:00100000:1.0:1787841969.197658:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 98 00000100:00100000:1.0:1787841969.197670:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf8eb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34e5681c-63ea-4fb9-89c0-59dcf324dc9b+12:13881:x1874687695108352:12345-192.168.201.1@tcp:256:mount.lustre.0 20000000:01000000:1.0:1787841969.197739:0:14315:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787841969.197763:0:14315:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787841969.197767:0:14315:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787841969.197770:0:14315:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787841969.197773:0:14315:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1787841969.203578:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf8eb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34e5681c-63ea-4fb9-89c0-59dcf324dc9b+12:13881:x1874687695108352:12345-192.168.201.1@tcp:256:mount.lustre.0 Request processed in 5898us (6135us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841969.203607:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 98 00000100:00100000:2.0:1787841969.209343:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841969.209511:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695108480 00000100:00100000:3.0:1787841969.209522:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695108480 00000100:00100000:3.0:1787841969.209577:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 99 00000100:00100000:3.0:1787841969.209587:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cc01d23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34e5681c-63ea-4fb9-89c0-59dcf324dc9b+12:13881:x1874687695108480:12345-192.168.201.1@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787841969.209606:0:14316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841969.209627:0:14316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92cbc149c400/0xe3dac0c99afff6a3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6c26 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841969.209659:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92cbc149c400/0xe3dac0c99afff6a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6c26 expref: 13 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841969.209671:0:14316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92cbc149c400/0xe3dac0c99afff6a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6c26 expref: 13 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841969.209680:0:14316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc149c400, rc 0) 00000100:00100000:3.0:1787841969.209816:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cc01d23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34e5681c-63ea-4fb9-89c0-59dcf324dc9b+13:13881:x1874687695108480:12345-192.168.201.1@tcp:101:mount.lustre.0 Request processed in 230us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841969.209824:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 99 00000100:00100000:0.0:1787841969.219193:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841969.223045:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695108608 00000100:00100000:1.0:1787841969.223062:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695108608 00000100:00100000:1.0:1787841969.223220:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 100 00000100:00100000:1.0:1787841969.223232:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cc01d23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34e5681c-63ea-4fb9-89c0-59dcf324dc9b+13:13881:x1874687695108608:12345-192.168.201.1@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787841969.223555:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cc01d23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34e5681c-63ea-4fb9-89c0-59dcf324dc9b+13:13881:x1874687695108608:12345-192.168.201.1@tcp:501:mount.lustre.0 Request processed in 324us (4373us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841969.223565:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 100 00000100:00100000:2.0:1787841969.228383:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841969.232811:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695108736 00000100:00100000:1.0:1787841969.232830:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695108736 00000100:00100000:1.0:1787841969.232917:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 101 00000100:00100000:1.0:1787841969.232928:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cc01d22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34e5681c-63ea-4fb9-89c0-59dcf324dc9b+13:13881:x1874687695108736:12345-192.168.201.1@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787841969.233195:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cc01d22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34e5681c-63ea-4fb9-89c0-59dcf324dc9b+13:13881:x1874687695108736:12345-192.168.201.1@tcp:503:mount.lustre.0 Request processed in 268us (4821us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841969.233204:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 101 00000100:00100000:2.0:1787841969.239745:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841969.239860:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695108864 00000100:00100000:1.0:1787841969.239872:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695108864 00000100:00100000:1.0:1787841969.239947:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 102 00000100:00100000:1.0:1787841969.239958:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cc01d22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34e5681c-63ea-4fb9-89c0-59dcf324dc9b+13:13892:x1874687695108864:12345-192.168.201.1@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787841969.240242:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cc01d22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34e5681c-63ea-4fb9-89c0-59dcf324dc9b+13:13892:x1874687695108864:12345-192.168.201.1@tcp:502:llog_process_th.0 Request processed in 285us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841969.240250:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 102 00000100:00100000:2.0:1787841969.251973:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841969.252482:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695108992 00000100:00100000:0.0:1787841969.252510:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695108992 00000100:00100000:0.0:1787841969.252575:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 103 00000100:00100000:0.0:1787841969.252585:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cc01d21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34e5681c-63ea-4fb9-89c0-59dcf324dc9b+13:13892:x1874687695108992:12345-192.168.201.1@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787841969.252869:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cc01d21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34e5681c-63ea-4fb9-89c0-59dcf324dc9b+13:13892:x1874687695108992:12345-192.168.201.1@tcp:502:llog_process_th.0 Request processed in 284us (905us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841969.252877:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 103 00000100:00100000:3.0:1787841969.262907:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841969.263491:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695109120 00000100:00100000:1.0:1787841969.263501:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695109120 00000100:00100000:1.0:1787841969.263603:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 10 00000100:00100000:1.0:1787841969.263612:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac3090780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2353:x1874687695109120:12345-192.168.201.1@tcp:38:mount.lustre.0 00010000:00080000:1.0:1787841969.263644:0:14324:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from d176eb3a-a183-4a09-a413-a2a087378ac7@192.168.201.1@tcp t0 exp 0000000000000000 cur 509 last 0 00000020:00000080:1.0:1787841969.263685:0:14324:0:(genops.c:1385:class_connect()) connect: client d176eb3a-a183-4a09-a413-a2a087378ac7, cookie 0xe3dac0c99afff6aa 00000004:00100000:1.0:1787841969.263751:0:14324:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1787841969.263871:0:14324:0:(import.c:65:import_set_state_nolock()) ffff92cbf736d000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787841969.263948:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac3090780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d176eb3a-a183-4a09-a413-a2a087378ac7+6:2353:x1874687695109120:12345-192.168.201.1@tcp:38:mount.lustre.0 Request processed in 335us (1053us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841969.263966:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 10 00000100:00100000:2.0:1787841969.271444:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841969.271546:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841969.271586:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841969.271692:0:15005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695109760 00000100:00100000:3.0:1787841969.271738:0:15005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695109760 00000100:00100000:3.0:1787841969.271788:0:15005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695109632 00000100:00100000:3.0:1787841969.271791:0:15005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695109632 00000100:00100000:3.0:1787841969.271820:0:15005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 5 00000100:00100000:3.0:1787841969.271828:0:15005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbd4bb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d29cd7d6-5033-4a84-a074-c74886c050cd+6:2355:x1874687695109760:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:2.0:1787841969.271975:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 6 00000100:00100000:2.0:1787841969.271985:0:15007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbd4bb0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d29cd7d6-5033-4a84-a074-c74886c050cd+5:2355:x1874687695109632:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:2.0:1787841969.272037:0:15007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbd4bb0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d29cd7d6-5033-4a84-a074-c74886c050cd+5:2355:x1874687695109632:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 56us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841969.272045:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 6 00000100:00100000:3.0:1787841969.272427:0:15005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbd4bb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d29cd7d6-5033-4a84-a074-c74886c050cd+6:2355:x1874687695109760:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 598us (879us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841969.272435:0:15005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 5 00000100:00100000:0.0:1787841969.273320:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695109504 00000100:00100000:0.0:1787841969.273329:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695109504 00000100:00100000:0.0:1787841969.273422:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 17 00000100:00100000:0.0:1787841969.273431:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbd4bb1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d29cd7d6-5033-4a84-a074-c74886c050cd+7:2355:x1874687695109504:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:0.0:1787841969.273499:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbd4bb1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d29cd7d6-5033-4a84-a074-c74886c050cd+7:2355:x1874687695109504:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 69us (2066us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841969.273507:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 17 00000100:00100000:2.0:1787841969.276671:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841969.276789:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841969.277374:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695109376 00000100:00100000:1.0:1787841969.277384:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695109376 00000100:00100000:1.0:1787841969.277457:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695109248 00000100:00100000:1.0:1787841969.277460:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695109248 00000100:00100000:1.0:1787841969.277478:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 11 00000100:00100000:1.0:1787841969.277487:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbd4bb2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d176eb3a-a183-4a09-a413-a2a087378ac7+7:13881:x1874687695109376:12345-192.168.201.1@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787841969.277536:0:14324:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787841969.277622:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbd4bb2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d176eb3a-a183-4a09-a413-a2a087378ac7+7:13881:x1874687695109376:12345-192.168.201.1@tcp:41:mount.lustre.0 Request processed in 135us (962us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841969.277630:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 11 00000100:00100000:1.0:1787841969.277653:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 12 00000100:00100000:1.0:1787841969.277660:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbd4bb2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d176eb3a-a183-4a09-a413-a2a087378ac7+6:0:x1874687695109248:12345-192.168.201.1@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787841969.277672:0:14324:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787841969.277693:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbd4bb2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d176eb3a-a183-4a09-a413-a2a087378ac7+6:0:x1874687695109248:12345-192.168.201.1@tcp:41:mount.lustre.0 Request processed in 35us (905us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841969.277728:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 12 00000100:00080000:2.0:1787841969.278797:0:14318:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787841969.282531:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841969.282638:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695109888 00000100:00100000:1.0:1787841969.282650:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695109888 00000100:00100000:1.0:1787841969.282804:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 13 00000100:00100000:1.0:1787841969.282815:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff3d1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d176eb3a-a183-4a09-a413-a2a087378ac7+6:13881:x1874687695109888:12345-192.168.201.1@tcp:40:mount.lustre.0 00000100:00100000:1.0:1787841969.282915:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff3d1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d176eb3a-a183-4a09-a413-a2a087378ac7+6:13881:x1874687695109888:12345-192.168.201.1@tcp:40:mount.lustre.0 Request processed in 102us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841969.282924:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 13 00000100:00100000:0.0:1787841969.286969:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841969.287016:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841969.287121:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695110272 00000100:00100000:3.0:1787841969.287132:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695110272 00000100:00100000:3.0:1787841969.287191:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 1 00000100:00100000:3.0:1787841969.287202:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac26dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d176eb3a-a183-4a09-a413-a2a087378ac7+6:13881:x1874687695110272:12345-192.168.201.1@tcp:33:mount.lustre.0 00000004:00200000:3.0:1787841969.287511:0:14326:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:3.0:1787841969.287664:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac26dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d176eb3a-a183-4a09-a413-a2a087378ac7+6:13881:x1874687695110272:12345-192.168.201.1@tcp:33:mount.lustre.0 Request processed in 464us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841969.287673:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 1 00000100:00100000:2.0:1787841969.291627:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695110016 00000100:00100000:2.0:1787841969.291645:0:15007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695110016 00000100:00100000:2.0:1787841969.291738:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 11 00000100:00100000:2.0:1787841969.291748:0:15007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac26dc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2353:x1874687695110016:12345-192.168.201.1@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787841969.291788:0:15007:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from d176eb3a-a183-4a09-a413-a2a087378ac7@192.168.201.1@tcp t0 exp 0000000000000000 cur 509 last 0 00000020:00000080:2.0:1787841969.291826:0:15007:0:(genops.c:1385:class_connect()) connect: client d176eb3a-a183-4a09-a413-a2a087378ac7, cookie 0xe3dac0c99afff6b1 00002000:00100000:2.0:1787841969.291839:0:15007:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d176eb3a-a183-4a09-a413-a2a087378ac7/ffff92cbf4218800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211395f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787841969.291851:0:15007:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787841969.292132:0:15007:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787841969.292163:0:15007:0:(import.c:65:import_set_state_nolock()) ffff92cbff5fc000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787841969.292353:0:15007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac26dc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d176eb3a-a183-4a09-a413-a2a087378ac7+6:2353:x1874687695110016:12345-192.168.201.1@tcp:8:mount.lustre.0 Request processed in 605us (5392us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841969.292362:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 11 00000100:00100000:0.0:1787841969.304443:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841969.304747:0:15005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695110144 00000100:00100000:1.0:1787841969.304758:0:15005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695110144 00000100:00100000:1.0:1787841969.304795:0:15005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 12 00000100:00100000:1.0:1787841969.304804:0:15005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac26dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2353:x1874687695110144:12345-192.168.201.1@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787841969.304838:0:15005:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from d176eb3a-a183-4a09-a413-a2a087378ac7@192.168.201.1@tcp t0 exp 0000000000000000 cur 509 last 0 00000020:00000080:1.0:1787841969.304870:0:15005:0:(genops.c:1385:class_connect()) connect: client d176eb3a-a183-4a09-a413-a2a087378ac7, cookie 0xe3dac0c99afff6b8 00002000:00100000:1.0:1787841969.304892:0:15005:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d176eb3a-a183-4a09-a413-a2a087378ac7/ffff92cbf736f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211395f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787841969.304905:0:15005:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787841969.305022:0:15005:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787841969.305054:0:15005:0:(import.c:65:import_set_state_nolock()) ffff92cbf7369800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787841969.305133:0:15005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac26dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d176eb3a-a183-4a09-a413-a2a087378ac7+6:2353:x1874687695110144:12345-192.168.201.1@tcp:8:mount.lustre.0 Request processed in 328us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841969.305142:0:15005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 12 00000100:00100000:0.0:1787841969.495002:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841969.495122:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695110400 00000100:00100000:2.0:1787841969.495132:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695110400 00000100:00100000:2.0:1787841969.495198:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 14 00000100:00100000:2.0:1787841969.495210:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac26ded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d176eb3a-a183-4a09-a413-a2a087378ac7+6:13913:x1874687695110400:12345-192.168.201.1@tcp:101:mkdir.0 00010000:00010000:2.0:1787841969.495246:0:14323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841969.495276:0:14323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104600/0xe3dac0c99afff6bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6c50 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841969.495479:0:14323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105c00/0xe3dac0c99afff6c6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841969.495496:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105c00/0xe3dac0c99afff6c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841969.495616:0:14323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105c00/0xe3dac0c99afff6c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787841969.495854:0:14323:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787841969.495859:0:14323:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1787841969.496154:0:14323:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105c00/0xe3dac0c99afff6c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841969.496188:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104600/0xe3dac0c99afff6bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6c50 expref: 8 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841969.496204:0:14323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105c00/0xe3dac0c99afff6c6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6c50 expref: 7 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841969.496213:0:14323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92cbcd829500) 00010000:00010000:2.0:1787841969.496216:0:14323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787841969.496220:0:14323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc6105c00, rc 0) 00000100:00100000:2.0:1787841969.496290:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac26ded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d176eb3a-a183-4a09-a413-a2a087378ac7+7:13913:x1874687695110400:12345-192.168.201.1@tcp:101:mkdir.0 Request processed in 1082us (1299us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841969.496298:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 14 00010000:00010000:0.0:1787841969.805119:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787841969.921129:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff3d0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874687715026432:0@lo:400:kworker.0 00000100:00100000:2.0:1787841969.921365:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841969.921442:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787841969.921449:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff3d1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874687715026304:0@lo:400:kworker.0 00000100:00100000:2.0:1787841969.921478:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841969.921518:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715026304 00000100:00100000:2.0:1787841969.921525:0:15007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715026304 00000100:00100000:2.0:1787841969.921582:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787841969.921591:0:15007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cc00ddda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1874687715026304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787841969.921646:0:15007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cc00ddda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1874687715026304:12345-0@lo:400:kworker.0 Request processed in 55us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841969.921652:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:2.0:1787841969.921680:0:14318:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787841969.921736:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff3d1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874687715026304:0@lo:400:kworker.0 00000100:00100000:3.0:1787841969.921886:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff3d0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:3300:1874687715026048:0@lo:400:kworker.0 00000100:00100000:3.0:1787841969.921922:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841969.921954:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff3d2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1874687715026560:0@lo:400:kworker.0 00000100:00100000:3.0:1787841969.921976:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841969.922003:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787841969.922008:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff3d3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874687715026176:0@lo:400:kworker.0 00000100:00100000:3.0:1787841969.922027:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841969.922040:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cc00ddf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1874687715026688:0@lo:400:kworker.0 00000100:00100000:3.0:1787841969.922055:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841969.922076:0:16199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715026176 00000100:00100000:3.0:1787841969.922080:0:16199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715026176 00000100:00100000:3.0:1787841969.922125:0:16199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787841969.922131:0:16199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e65680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1874687715026176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841969.922345:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715026432 00000100:00100000:0.0:1787841969.922351:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715026432 00000100:00100000:0.0:1787841969.922374:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715026560 00000100:00100000:0.0:1787841969.922376:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715026560 00000100:00100000:0.0:1787841969.922389:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715026688 00000100:00100000:0.0:1787841969.922392:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715026688 00000100:00100000:0.0:1787841969.922406:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787841969.922412:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cc00ddf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874687715026432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841969.922556:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787841969.922564:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff4d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874687715026816:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787841969.922623:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715026048 00000100:00100000:2.0:1787841969.922627:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715026048 00000100:00100000:2.0:1787841969.922651:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787841969.922657:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cc01d23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+19:3300:x1874687715026048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841969.927448:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cc00ddf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874687715026432:12345-0@lo:400:kworker.0 Request processed in 5021us (6069us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841969.927478:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787841969.927522:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787841969.927536:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e66580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874687715026560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841969.927604:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e66580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874687715026560:12345-0@lo:400:kworker.0 Request processed in 75us (5626us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841969.927611:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787841969.927623:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787841969.927630:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874687715026688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841969.927659:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874687715026688:12345-0@lo:400:kworker.0 Request processed in 30us (5602us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841969.927665:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787841969.928373:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841969.928452:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff3d0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874687715026432:0@lo:400:kworker.0 00000100:00100000:1.0:1787841969.928514:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715026816 00000100:00100000:1.0:1787841969.928530:0:15010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715026816 00000100:00100000:1.0:1787841969.928577:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787841969.928585:0:15010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff4d4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874687715026816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787841969.928610:0:15010:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787841969.928658:0:15010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff4d4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874687715026816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841969.928665:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787841969.928734:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff4d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874687715026816:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1787841969.928818:0:14318:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787841969.928824:0:14318:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787841969.936800:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff3d3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874687715026176:0@lo:400:kworker.0 00000100:00100000:1.0:1787841969.936853:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cc00ddf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1874687715026688:0@lo:400:kworker.0 00000100:00100000:1.0:1787841969.936868:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff3d2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1874687715026560:0@lo:400:kworker.0 00000100:00100000:2.0:1787841969.950261:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cc01d23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+19:3300:x1874687715026048:12345-0@lo:400:kworker.0 Request processed in 27591us (28326us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841969.950280:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787841969.951024:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff3d0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:3300:1874687715026048:0@lo:400:kworker.0 00000100:00100000:3.0:1787841969.960884:0:16199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e65680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1874687715026176:12345-0@lo:400:kworker.0 Request processed in 38732us (38834us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841969.960903:0:16199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000001:00100000:2.0:1787841970.527840:0:7643:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d29cd7d6-5033-4a84-a074-c74886c050cd 00000001:00100000:2.0:1787841970.527856:0:7643:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d176eb3a-a183-4a09-a413-a2a087378ac7 00010000:00010000:1.0:1787841970.820139:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787841971.500866:0:5860:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d176eb3a-a183-4a09-a413-a2a087378ac7 00000001:00100000:2.0:1787841971.500883:0:5860:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d29cd7d6-5033-4a84-a074-c74886c050cd 00010000:00010000:0.0:1787841971.847766:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841972.865888:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787841972.993825:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac26dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874687715026944:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787841972.993906:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841972.993998:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715026944 00000100:00100000:0.0:1787841972.994007:0:15010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715026944 00000100:00100000:0.0:1787841972.994081:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787841972.994091:0:15010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac26df0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874687715026944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787841972.994139:0:15010:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787841972.994186:0:15010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac26df0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874687715026944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841972.994193:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1787841972.994217:0:14318:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787841972.994252:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac26dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874687715026944:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1787841973.048543:0:16290:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000040:00080000:2.0:1787841973.378221:0:14354:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787841973.888971:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787841974.056694:0:6717:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d176eb3a-a183-4a09-a413-a2a087378ac7 00000100:00100000:2.0:1787841974.430225:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841974.430262:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841974.430287:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841974.430303:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841974.430319:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841974.430335:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841974.430354:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841974.430394:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695110784 00000100:00100000:2.0:1787841974.430405:0:15007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695110784 00000100:00100000:2.0:1787841974.430455:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695111296 00000100:00100000:2.0:1787841974.430458:0:15007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695111296 00000100:00100000:2.0:1787841974.430474:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695110912 00000100:00100000:2.0:1787841974.430476:0:15007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695110912 00000100:00100000:2.0:1787841974.430488:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695111168 00000100:00100000:2.0:1787841974.430491:0:15007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695111168 00000100:00100000:2.0:1787841974.430505:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 9 00000100:00100000:2.0:1787841974.430516:0:15007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cc00dde1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d29cd7d6-5033-4a84-a074-c74886c050cd+5:2354:x1874687695110784:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:2.0:1787841974.430597:0:15007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cc00dde1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d29cd7d6-5033-4a84-a074-c74886c050cd+5:2354:x1874687695110784:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 84us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841974.430605:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 9 00000100:00100000:2.0:1787841974.430622:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 10 00000100:00100000:2.0:1787841974.430628:0:15007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cc00ddcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d176eb3a-a183-4a09-a413-a2a087378ac7+5:2354:x1874687695111296:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:2.0:1787841974.430651:0:15007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cc00ddcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d176eb3a-a183-4a09-a413-a2a087378ac7+5:2354:x1874687695111296:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 24us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841974.430656:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 10 00000100:00100000:2.0:1787841974.430666:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 11 00000100:00100000:2.0:1787841974.430673:0:15007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cc00ddde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d29cd7d6-5033-4a84-a074-c74886c050cd+5:2354:x1874687695110912:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:2.0:1787841974.430731:0:15007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cc00ddde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d29cd7d6-5033-4a84-a074-c74886c050cd+5:2354:x1874687695110912:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 59us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841974.430737:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 11 00000100:00100000:2.0:1787841974.430749:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 12 00000100:00100000:2.0:1787841974.430755:0:15007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cc00ddcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d176eb3a-a183-4a09-a413-a2a087378ac7+5:2354:x1874687695111168:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:2.0:1787841974.430777:0:15007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cc00ddcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d176eb3a-a183-4a09-a413-a2a087378ac7+5:2354:x1874687695111168:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 22us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841974.430783:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 12 00000100:00100000:1.0:1787841974.431134:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695111040 00000100:00100000:1.0:1787841974.431140:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695111040 00000100:00100000:1.0:1787841974.431179:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695110656 00000100:00100000:1.0:1787841974.431182:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695110656 00000100:00100000:1.0:1787841974.431198:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 21 00000100:00100000:1.0:1787841974.431206:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cc00ddc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d176eb3a-a183-4a09-a413-a2a087378ac7+6:2354:x1874687695111040:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:1.0:1787841974.431236:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cc00ddc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d176eb3a-a183-4a09-a413-a2a087378ac7+6:2354:x1874687695111040:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 31us (948us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841974.431241:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 21 00000100:00100000:1.0:1787841974.431263:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 22 00000100:00100000:1.0:1787841974.431269:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cc00ddf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d29cd7d6-5033-4a84-a074-c74886c050cd+6:2354:x1874687695110656:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:1.0:1787841974.431294:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cc00ddf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d29cd7d6-5033-4a84-a074-c74886c050cd+6:2354:x1874687695110656:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 26us (975us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841974.431299:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 22 00000100:00100000:0.0:1787841974.432174:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695110528 00000100:00100000:0.0:1787841974.432181:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695110528 00000100:00100000:0.0:1787841974.432222:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 105 00000100:00100000:0.0:1787841974.432230:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cc01d21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34e5681c-63ea-4fb9-89c0-59dcf324dc9b+13:2354:x1874687695110528:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:0.0:1787841974.432265:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cc01d21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34e5681c-63ea-4fb9-89c0-59dcf324dc9b+13:2354:x1874687695110528:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 36us (2050us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841974.432272:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 105 00000100:00080000:0.0:1787841974.432305:0:14318:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787841974.432310:0:14318:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787841974.432312:0:14318:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787841974.913750:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787841975.042305:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff4d61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874687715027072:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787841975.042385:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841975.042466:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715027072 00000100:00100000:1.0:1787841975.042474:0:15010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715027072 00000100:00100000:1.0:1787841975.042551:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787841975.042561:0:15010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff4d52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874687715027072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787841975.042606:0:15010:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787841975.042651:0:15010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff4d52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874687715027072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841975.042659:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1787841975.042680:0:14318:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787841975.042734:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff4d61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874687715027072:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787841975.044690:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff4d7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687715027328:0@lo:400:kworker.0 00000100:00100000:1.0:1787841975.046025:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841975.046368:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715027328 00000100:00100000:3.0:1787841975.046378:0:15007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715027328 00000100:00100000:3.0:1787841975.046446:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787841975.046456:0:15007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff4d4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3298:x1874687715027328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841975.047248:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787841975.047262:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff4d7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874687715027456:0@lo:400:kworker.0 00000100:00100000:3.0:1787841975.047421:0:15007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff4d4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3298:x1874687715027328:12345-0@lo:400:kworker.0 Request processed in 966us (1400us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841975.047430:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:3.0:1787841975.047467:0:14318:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787841975.047659:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841975.047734:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff4d7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687715027328:0@lo:400:kworker.0 00000100:00100000:1.0:1787841975.047790:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff4d61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:3301:1874687715027200:0@lo:400:kworker.0 00000100:00100000:1.0:1787841975.047829:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841975.048413:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715027456 00000100:00100000:3.0:1787841975.048420:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715027456 00000100:00100000:3.0:1787841975.048466:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787841975.048475:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff4d6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874687715027456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841975.049774:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff4d5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1874687715027584:0@lo:400:kworker.0 00000100:00100000:3.0:1787841975.049922:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff4d6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874687715027456:12345-0@lo:400:kworker.0 Request processed in 1446us (2261us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841975.049931:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787841975.049992:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff4d7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874687715027456:0@lo:400:kworker.0 00000100:00100000:1.0:1787841975.057654:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff4d70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1874687715027712:0@lo:400:kworker.0 00000100:00100000:1.0:1787841975.057758:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841975.057836:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715027200 00000100:00100000:1.0:1787841975.057853:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715027200 00000100:00100000:1.0:1787841975.057907:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787841975.057917:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cc01d20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+19:3301:x1874687715027200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841975.057973:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cc01d20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+19:3301:x1874687715027200:12345-0@lo:400:kworker.0 Request processed in 58us (10142us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841975.057981:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787841975.058043:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff4d61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:3301:1874687715027200:0@lo:400:kworker.0 00000100:00100000:1.0:1787841975.059063:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841975.059241:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715027712 00000100:00100000:3.0:1787841975.059249:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715027712 00000100:00100000:3.0:1787841975.059295:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715027584 00000100:00100000:3.0:1787841975.059299:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715027584 00000100:00100000:3.0:1787841975.059316:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787841975.059323:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff4d7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874687715027712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787841975.059390:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff4d7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874687715027712:12345-0@lo:400:kworker.0 Request processed in 67us (1633us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841975.059397:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787841975.059412:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787841975.059417:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff4d61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874687715027584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787841975.059442:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff4d61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874687715027584:12345-0@lo:400:kworker.0 Request processed in 25us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841975.059448:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:3.0:1787841975.059465:0:14318:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787841975.059774:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff4d5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1874687715027584:0@lo:400:kworker.0 00000100:00100000:1.0:1787841975.059786:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff4d70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1874687715027712:0@lo:400:kworker.0 00010000:00010000:2.0:1787841975.944977:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841976.963406:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787841977.417021:0:16441:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd27a13b20 20000000:00000080:1.0:1787841977.417039:0:16441:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff92cac1a5e400 uarg=0000000000000000 20000000:01000000:1.0:1787841977.417077:0:16441:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787841977.417083:0:16441:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787841977.417088:0:16441:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1787841977.418387:0:16442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:2.0:1787841977.418557:0:16441:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1787841977.429895:0:16441:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787841977.429927:0:16441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff92cbc6105400/0xe3dac0c99afff6cd lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.430143:0:16441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92cc00d9de00/0xe3dac0c99afff3c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe3dac0c99afff3bd expref: 18 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.430152:0:16441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92cbc6104400/0xe3dac0c99afff411 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe3dac0c99afff40a expref: 18 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.430160:0:16441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92cbc149de00/0xe3dac0c99afff545 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe3dac0c99afff53e expref: 18 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.430169:0:16441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92cbc6104200/0xe3dac0c99afff66b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6bc4 expref: 12 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.430176:0:16441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92cbc149c400/0xe3dac0c99afff6a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6c26 expref: 12 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841977.430197:0:16441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff92cbc6105400/0xe3dac0c99afff6cd lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.430374:0:16441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92cbc149c400/0xe3dac0c99afff6a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6c26 expref: 12 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.430391:0:16441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92cbc149c400/0xe3dac0c99afff6a3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6c26 expref: 12 pid: 14316 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841977.430408:0:16441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e64000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16441:1874687715027840:192.168.201.1@tcp:104: 00010000:00010000:3.0:1787841977.430577:0:16441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92cbc6104200/0xe3dac0c99afff66b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6bc4 expref: 12 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.430586:0:16441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92cbc6104200/0xe3dac0c99afff66b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6bc4 expref: 12 pid: 14316 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841977.430595:0:16441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e652c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16441:1874687715027968:192.168.201.1@tcp:104: 00010000:00010000:3.0:1787841977.430626:0:16441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92cbc149de00/0xe3dac0c99afff545 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe3dac0c99afff53e expref: 18 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.430634:0:16441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92cbc149de00/0xe3dac0c99afff545 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe3dac0c99afff53e expref: 18 pid: 14316 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841977.430651:0:16441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e661c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16441:1874687715028096:0@lo:104: 00000100:00100000:3.0:1787841977.430693:0:16441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787841977.431031:0:16441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92cbc6104400/0xe3dac0c99afff411 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe3dac0c99afff40a expref: 18 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.431198:0:16441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92cbc6104400/0xe3dac0c99afff411 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe3dac0c99afff40a expref: 18 pid: 14317 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841977.431208:0:16441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e64f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16441:1874687715028224:0@lo:104: 00000100:00100000:3.0:1787841977.431238:0:16441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787841977.436459:0:16441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92cc00d9de00/0xe3dac0c99afff3c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe3dac0c99afff3bd expref: 18 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.436476:0:16441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92cc00d9de00/0xe3dac0c99afff3c4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe3dac0c99afff3bd expref: 18 pid: 14315 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841977.436489:0:16441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e66940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16441:1874687715028352:0@lo:104: 00000100:00100000:3.0:1787841977.436547:0:16441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841977.436641:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841977.436747:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841977.436774:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695111424 00000100:00100000:1.0:1787841977.436782:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695111424 00010000:00010000:1.0:1787841977.436817:0:14308:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92cbc149c400/0xe3dac0c99afff6a3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6c26 expref: 13 pid: 14316 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841977.436862:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695111552 00000100:00100000:1.0:1787841977.436866:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695111552 00010000:00010000:1.0:1787841977.436890:0:14308:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92cbc6104200/0xe3dac0c99afff66b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6bc4 expref: 14 pid: 14316 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841977.436905:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 4 00000100:00100000:1.0:1787841977.436913:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff4d70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:34e5681c-63ea-4fb9-89c0-59dcf324dc9b+14:2357:x1874687695111424:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787841977.436925:0:14308:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787841977.436931:0:14308:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92cbc149c400/0xe3dac0c99afff6a3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6c26 expref: 14 pid: 14316 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841977.436942:0:14308:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92cbc149c400/0xe3dac0c99afff6a3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6c26 expref: 14 pid: 14316 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841977.436979:0:14308:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787841977.437023:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff4d70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:34e5681c-63ea-4fb9-89c0-59dcf324dc9b+14:2357:x1874687695111424:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 111us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841977.437030:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 4 00000100:00100000:1.0:1787841977.437508:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 5 00000100:00100000:1.0:1787841977.437518:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff4d5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:34e5681c-63ea-4fb9-89c0-59dcf324dc9b+13:2356:x1874687695111552:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787841977.437528:0:14308:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787841977.437533:0:14308:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92cbc6104200/0xe3dac0c99afff66b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6bc4 expref: 13 pid: 14316 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841977.437542:0:14308:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92cbc6104200/0xe3dac0c99afff66b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6bc4 expref: 13 pid: 14316 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841977.437566:0:14308:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787841977.437588:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff4d5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:34e5681c-63ea-4fb9-89c0-59dcf324dc9b+13:2356:x1874687695111552:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 72us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841977.437595:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 5 00000100:00100000:0.0:1787841977.439372:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715028096 00000100:00100000:0.0:1787841977.439387:0:14306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715028096 00000100:00100000:1.0:1787841977.439945:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715028224 00000100:00100000:1.0:1787841977.439952:0:14306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715028224 00000100:00100000:1.0:1787841977.439979:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787841977.439988:0:14306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e64780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+4:16441:x1874687715028096:12345-0@lo:104: 00010000:00010000:1.0:1787841977.440006:0:14306:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.101@tcp lock: ffff92cbc149ce00/0xe3dac0c99afff53e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe3dac0c99afff545 expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841977.440096:0:14306:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787841977.440102:0:14306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e64780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+4:16441:x1874687715028096:12345-0@lo:104: Request processed in 115us (9410us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841977.440108:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1787841977.440127:0:14311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787841977.440133:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.101@tcp lock: ffff92cbc149ce00/0xe3dac0c99afff53e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe3dac0c99afff545 expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841977.440140:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc149ce00 already unused, calling callback (ffffffffc1d9fc20) 10000000:00010000:1.0:1787841977.440144:0:14311:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.101@tcp lock: ffff92cbc149ce00/0xe3dac0c99afff53e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xe3dac0c99afff545 expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841977.440152:0:14311:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.101@tcp lock: ffff92cbc149ce00/0xe3dac0c99afff53e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xe3dac0c99afff545 expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787841977.440160:0:14311:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.101@tcp lock: ffff92cbc149ce00/0xe3dac0c99afff53e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xe3dac0c99afff545 expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787841977.440183:0:14311:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787841977.440223:0:14311:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.101@tcp lock: ffff92cbc149ce00/0xe3dac0c99afff53e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99afff545 expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841977.440230:0:14311:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787841977.440252:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.101@tcp lock: ffff92cbc149ce00/0xe3dac0c99afff53e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99afff545 expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841977.440260:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.101@tcp lock: ffff92cbc149ce00/0xe3dac0c99afff53e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99afff545 expref: -99 pid: 15725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841977.440276:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841977.440278:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841977.440280:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787841977.440302:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff4d5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:3298:1874687715028480:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787841977.440347:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841977.440396:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715028480 00000100:00100000:1.0:1787841977.440400:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715028480 00010000:00010000:1.0:1787841977.440418:0:14308:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92cbc149de00/0xe3dac0c99afff545 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe3dac0c99afff53e expref: 19 pid: 14316 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841977.440439:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787841977.440446:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf7333050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+19:3298:x1874687715028480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787841977.440456:0:14308:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787841977.440460:0:14308:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92cbc149de00/0xe3dac0c99afff545 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe3dac0c99afff53e expref: 19 pid: 14316 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841977.440471:0:14308:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92cbc149de00/0xe3dac0c99afff545 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe3dac0c99afff53e expref: 19 pid: 14316 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841977.440497:0:14308:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787841977.440524:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf7333050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+19:3298:x1874687715028480:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841977.440531:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787841977.440586:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff4d5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:3298:1874687715028480:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787841977.440603:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787841977.440609:0:14306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e66d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+3:16441:x1874687715028224:12345-0@lo:104: 00010000:00010000:1.0:1787841977.440617:0:14306:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.101@tcp lock: ffff92cc00d9d800/0xe3dac0c99afff40a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe3dac0c99afff411 expref: -99 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841977.440646:0:14306:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787841977.440651:0:14306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e66d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+3:16441:x1874687715028224:12345-0@lo:104: Request processed in 43us (9413us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841977.440657:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1787841977.440668:0:14310:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787841977.440672:0:14310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.101@tcp lock: ffff92cc00d9d800/0xe3dac0c99afff40a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe3dac0c99afff411 expref: -99 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841977.440679:0:14310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cc00d9d800 already unused, calling callback (ffffffffc1d9fc20) 10000000:00010000:1.0:1787841977.440683:0:14310:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.101@tcp lock: ffff92cc00d9d800/0xe3dac0c99afff40a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe3dac0c99afff411 expref: -99 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841977.440691:0:14310:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.101@tcp lock: ffff92cc00d9d800/0xe3dac0c99afff40a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe3dac0c99afff411 expref: -99 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787841977.440724:0:14310:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.101@tcp lock: ffff92cc00d9d800/0xe3dac0c99afff40a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe3dac0c99afff411 expref: -99 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787841977.440750:0:14310:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787841977.440768:0:14310:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.101@tcp lock: ffff92cc00d9d800/0xe3dac0c99afff40a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99afff411 expref: -99 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841977.440774:0:14310:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787841977.440783:0:14310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.101@tcp lock: ffff92cc00d9d800/0xe3dac0c99afff40a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99afff411 expref: -99 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841977.440790:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.101@tcp lock: ffff92cc00d9d800/0xe3dac0c99afff40a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99afff411 expref: -99 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841977.440799:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841977.440801:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841977.440802:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787841977.440809:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff4d5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:3299:1874687715028608:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787841977.440832:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841977.440856:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715028608 00000100:00100000:1.0:1787841977.440859:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715028608 00010000:00010000:1.0:1787841977.440871:0:14309:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92cbc6104400/0xe3dac0c99afff411 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe3dac0c99afff40a expref: 19 pid: 14317 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841977.440888:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787841977.440893:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff4d70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+19:3299:x1874687715028608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787841977.440899:0:14309:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787841977.440903:0:14309:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92cbc6104400/0xe3dac0c99afff411 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe3dac0c99afff40a expref: 19 pid: 14317 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841977.440912:0:14309:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92cbc6104400/0xe3dac0c99afff411 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe3dac0c99afff40a expref: 19 pid: 14317 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841977.440929:0:14309:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787841977.440951:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff4d70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+19:3299:x1874687715028608:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841977.440957:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787841977.440994:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff4d5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:3299:1874687715028608:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787841977.441332:0:16441:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbe9984f00 going to sleep for 11 seconds 00010000:00010000:3.0:1787841977.441352:0:16441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92cbc149c400/0xe3dac0c99afff6a3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6c26 expref: 12 pid: 14316 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841977.441364:0:16441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e64000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16441:1874687715027840:192.168.201.1@tcp:104: 00010000:00010000:3.0:1787841977.441374:0:16441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92cbc6104200/0xe3dac0c99afff66b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6bc4 expref: 11 pid: 14316 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841977.441382:0:16441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e652c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16441:1874687715027968:192.168.201.1@tcp:104: 00010000:00010000:3.0:1787841977.441401:0:16441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92cbc149de00/0xe3dac0c99afff545 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe3dac0c99afff53e expref: 18 pid: 14316 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841977.441410:0:16441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e661c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16441:1874687715028096:0@lo:104: 00010000:00010000:3.0:1787841977.441418:0:16441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92cbc6104400/0xe3dac0c99afff411 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe3dac0c99afff40a expref: 17 pid: 14317 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841977.441425:0:16441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e64f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16441:1874687715028224:0@lo:104: 00000100:00100000:1.0:1787841977.441480:0:14306:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787841977.441489:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715028352 00000100:00100000:1.0:1787841977.441493:0:14306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715028352 00000100:00100000:1.0:1787841977.441550:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787841977.441557:0:14306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff582450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+3:16441:x1874687715028352:12345-0@lo:104: 00010000:00010000:1.0:1787841977.441566:0:14306:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.101@tcp lock: ffff92cbc6105200/0xe3dac0c99afff3bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe3dac0c99afff3c4 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841977.441612:0:14306:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787841977.441617:0:14306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff582450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+3:16441:x1874687715028352:12345-0@lo:104: Request processed in 62us (5070us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841977.441623:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1787841977.441655:0:14311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787841977.441660:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.101@tcp lock: ffff92cbc6105200/0xe3dac0c99afff3bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe3dac0c99afff3c4 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841977.441667:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6105200 already unused, calling callback (ffffffffc1d9fc20) 10000000:00010000:1.0:1787841977.441671:0:14311:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.101@tcp lock: ffff92cbc6105200/0xe3dac0c99afff3bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe3dac0c99afff3c4 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841977.441679:0:14311:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.101@tcp lock: ffff92cbc6105200/0xe3dac0c99afff3bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe3dac0c99afff3c4 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787841977.441719:0:14311:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.101@tcp lock: ffff92cbc6105200/0xe3dac0c99afff3bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe3dac0c99afff3c4 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787841977.441725:0:14311:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787841977.441756:0:14311:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.101@tcp lock: ffff92cbc6105200/0xe3dac0c99afff3bd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99afff3c4 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841977.441762:0:14311:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787841977.441777:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.101@tcp lock: ffff92cbc6105200/0xe3dac0c99afff3bd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99afff3c4 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841977.441784:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.101@tcp lock: ffff92cbc6105200/0xe3dac0c99afff3bd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe3dac0c99afff3c4 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841977.441796:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841977.441798:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841977.441800:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787841977.441809:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff4d5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:3300:1874687715028736:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787841977.441833:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841977.441860:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715028736 00000100:00100000:1.0:1787841977.441863:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715028736 00010000:00010000:1.0:1787841977.441876:0:14307:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92cc00d9de00/0xe3dac0c99afff3c4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe3dac0c99afff3bd expref: 17 pid: 14315 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841977.441892:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787841977.441897:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff4d5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+17:3300:x1874687715028736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787841977.441904:0:14307:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787841977.441909:0:14307:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92cc00d9de00/0xe3dac0c99afff3c4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe3dac0c99afff3bd expref: 17 pid: 14315 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841977.441923:0:14307:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92cc00d9de00/0xe3dac0c99afff3c4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe3dac0c99afff3bd expref: 17 pid: 14315 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841977.441936:0:14307:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff92cbc6105400/0xe3dac0c99afff6cd lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841977.441944:0:14307:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92cbc6105400/0xe3dac0c99afff6cd lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841977.441957:0:14307:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92cbc6105400/0xe3dac0c99afff6cd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841977.441975:0:14307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92cbc6105400/0xe3dac0c99afff6cd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841977.441983:0:14307:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff92cbc6105400/0xe3dac0c99afff6cd lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841977.441990:0:14307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff92cbc6105400/0xe3dac0c99afff6cd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841977.441995:0:14307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6105400 already unused, calling callback (ffffffffc17a4500) 00010000:00010000:1.0:1787841977.441999:0:14307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff92cbc6105400/0xe3dac0c99afff6cd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841977.442007:0:14307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff92cbc6105400/0xe3dac0c99afff6cd lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841977.442015:0:14307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff92cbc6105400/0xe3dac0c99afff6cd lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841977.442033:0:14307:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787841977.442177:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff4d5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+17:3300:x1874687715028736:12345-0@lo:103:ldlm_bl.0 Request processed in 279us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841977.442184:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787841977.442212:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff4d5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:3300:1874687715028736:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787841977.442286:0:16441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92cc00d9de00/0xe3dac0c99afff3c4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe3dac0c99afff3bd expref: 16 pid: 14315 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841977.442296:0:16441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e66940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16441:1874687715028352:0@lo:104: 00010000:00010000:3.0:1787841977.442321:0:16441:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff92cbc6105400/0xe3dac0c99afff6cd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.442330:0:16441:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff92cbc6105400/0xe3dac0c99afff6cd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.442336:0:16441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff92cbc6105400/0xe3dac0c99afff6cd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841977.442343:0:16441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92cbc6105400/0xe3dac0c99afff6cd lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841977.985644:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787841978.113227:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac26dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874687715028864:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787841978.113302:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841978.113496:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715028864 00000100:00100000:2.0:1787841978.113504:0:15010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715028864 00000100:00100000:2.0:1787841978.113561:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787841978.113570:0:15010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff4d4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874687715028864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787841978.113604:0:15010:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1787841978.113684:0:14318:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787841978.118381:0:15010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff4d4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874687715028864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4800us (5067us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841978.118396:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787841978.118573:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac26dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874687715028864:0@lo:13:osp-pre-0-0.0 10000000:01000000:1.0:1787841979.011514:0:14319:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787841979.011522:0:14319:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92cbf6eb1800 from 10 10000000:01000000:1.0:1787841979.011527:0:14319:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787841979.011575:0:14319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cac3330c00/0xe3dac0c99afff6d4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841979.011588:0:14319:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff92cac3330c00/0xe3dac0c99afff6d4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841979.011600:0:14319:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff92cac3330c00/0xe3dac0c99afff6d4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841979.011628:0:14319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff4d6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:14319:1874687715028992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787841979.011743:0:14319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841979.011808:0:14319:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbcdb29cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787841979.012223:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715028992 00000100:00100000:0.0:1787841979.012232:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715028992 00000100:00100000:0.0:1787841979.012293:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787841979.012304:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cc01d23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+16:14319:x1874687715028992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787841979.012319:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841979.012334:0:14315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92cbc6724a00/0xe3dac0c99afff6db lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe3dac0c99afff6d4 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841979.012360:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92cbc6724a00/0xe3dac0c99afff6db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe3dac0c99afff6d4 expref: 17 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841979.012387:0:14315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92cbc6724a00/0xe3dac0c99afff6db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe3dac0c99afff6d4 expref: 17 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841979.012397:0:14315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc6724a00, rc 0) 00000100:00100000:0.0:1787841979.012453:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cc01d23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+17:14319:x1874687715028992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841979.012461:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787841979.013751:0:14319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff4d6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:14319:1874687715028992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787841979.013776:0:14319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff92cac3330c00/0xe3dac0c99afff6d4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99afff6db expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841979.013947:0:14319:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff92cac3330c00/0xe3dac0c99afff6d4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe3dac0c99afff6db expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841979.014178:0:14319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff4d6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:14319:1874687715029120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787841979.014240:0:14319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841979.014285:0:14319:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbcdb29cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787841979.014476:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715029120 00000100:00100000:0.0:1787841979.014483:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715029120 00000100:00100000:0.0:1787841979.014534:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787841979.014543:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cc01d20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+17:14319:x1874687715029120:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787841979.015674:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cc01d20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+17:14319:x1874687715029120:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1127us (1429us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841979.015686:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787841979.018356:0:14319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff4d6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:14319:1874687715029120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787841979.018421:0:14319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff4d6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:14319:1874687715029248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787841979.018520:0:14319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841979.018567:0:14319:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbcdb29cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787841979.018694:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715029248 00000100:00100000:0.0:1787841979.018731:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715029248 00000100:00100000:0.0:1787841979.018793:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787841979.018803:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cc01d20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+17:14319:x1874687715029248:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787841979.019016:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cc01d20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+17:14319:x1874687715029248:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 214us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841979.019024:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787841979.019274:0:14319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff4d6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:14319:1874687715029248:0@lo:503:ll_cfg_requeue.0 00010000:00010000:1.0:1787841979.019829:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787841979.021421:0:16509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1787841979.022558:0:14319:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1787841979.022580:0:14319:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787841979.022591:0:14319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cac3330c00/0xe3dac0c99afff6d4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99afff6db expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841979.022616:0:14319:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff92cac3330c00/0xe3dac0c99afff6d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99afff6db expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787841979.022627:0:14319:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787841979.022630:0:14319:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92cbf71ac000 from 10 10000000:01000000:0.0:1787841979.022632:0:14319:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787841979.022667:0:14319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc6724c00/0xe3dac0c99afff6e2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841979.022674:0:14319:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff92cbc6724c00/0xe3dac0c99afff6e2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841979.022684:0:14319:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff92cbc6724c00/0xe3dac0c99afff6e2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841979.022740:0:14319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac26dd2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:14319:1874687715029376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787841979.023005:0:14319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841979.023052:0:14319:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc63e4780 going to sleep for 11 seconds 00000100:00100000:3.0:1787841979.023165:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715029376 00000100:00100000:3.0:1787841979.023173:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715029376 00000100:00100000:3.0:1787841979.023226:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787841979.023235:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cc01d21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+17:14319:x1874687715029376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787841979.023259:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841979.023272:0:14315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92cbc149c400/0xe3dac0c99afff6e9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe3dac0c99afff6e2 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841979.023297:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92cbc149c400/0xe3dac0c99afff6e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe3dac0c99afff6e2 expref: 18 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841979.023309:0:14315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92cbc149c400/0xe3dac0c99afff6e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe3dac0c99afff6e2 expref: 18 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841979.023318:0:14315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc149c400, rc 0) 00000100:00100000:3.0:1787841979.023362:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cc01d21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+18:14319:x1874687715029376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841979.023370:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787841979.023419:0:14319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac26dd2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:14319:1874687715029376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787841979.027576:0:14319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff92cbc6724c00/0xe3dac0c99afff6e2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99afff6e9 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841979.027599:0:14319:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff92cbc6724c00/0xe3dac0c99afff6e2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe3dac0c99afff6e9 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841979.027862:0:14319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e65a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:14319:1874687715029504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787841979.028033:0:14319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841979.028075:0:14319:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbe9984f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787841979.028142:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715029504 00000100:00100000:1.0:1787841979.028148:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715029504 00000100:00100000:1.0:1787841979.028201:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787841979.028212:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cc01d20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+18:14319:x1874687715029504:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787841979.028497:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cc01d20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+18:14319:x1874687715029504:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 286us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841979.028505:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787841979.028641:0:14319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e65a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:14319:1874687715029504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787841979.028678:0:14319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac26dcf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:14319:1874687715029632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787841979.028755:0:14319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841979.028791:0:14319:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc63e4780 going to sleep for 11 seconds 00000100:00100000:1.0:1787841979.030291:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715029632 00000100:00100000:1.0:1787841979.030302:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715029632 00000100:00100000:1.0:1787841979.030357:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787841979.030367:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cc01d21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+18:14319:x1874687715029632:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787841979.030596:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cc01d21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+18:14319:x1874687715029632:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 230us (1839us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841979.030612:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787841979.031178:0:14319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac26dcf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:14319:1874687715029632:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787841979.032683:0:16510:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1787841979.036374:0:14319:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1787841979.036402:0:14319:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787841979.036416:0:14319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc6724c00/0xe3dac0c99afff6e2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99afff6e9 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841979.036463:0:14319:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff92cbc6724c00/0xe3dac0c99afff6e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99afff6e9 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787841979.036475:0:14319:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787841979.036478:0:14319:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92cac3549800 from 10 10000000:01000000:3.0:1787841979.036480:0:14319:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787841979.036516:0:14319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc149de00/0xe3dac0c99afff6f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841979.036524:0:14319:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.101@tcp lock: ffff92cbc149de00/0xe3dac0c99afff6f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841979.036534:0:14319:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.101@tcp lock: ffff92cbc149de00/0xe3dac0c99afff6f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841979.036562:0:14319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e66940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:14319:1874687715029760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787841979.036634:0:14319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841979.036680:0:14319:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbe9984300 going to sleep for 11 seconds 00000100:00100000:1.0:1787841979.036961:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715029760 00000100:00100000:1.0:1787841979.036969:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715029760 00000100:00100000:1.0:1787841979.037027:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787841979.037037:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cc01d22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+18:14319:x1874687715029760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787841979.037049:0:14316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841979.037064:0:14316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92cac3330e00/0xe3dac0c99afff6f7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe3dac0c99afff6f0 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841979.037087:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92cac3330e00/0xe3dac0c99afff6f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe3dac0c99afff6f0 expref: 19 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841979.037099:0:14316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92cac3330e00/0xe3dac0c99afff6f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe3dac0c99afff6f0 expref: 19 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841979.037107:0:14316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cac3330e00, rc 0) 00000100:00100000:1.0:1787841979.037152:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cc01d22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+19:14319:x1874687715029760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841979.037159:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787841979.037246:0:14319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e66940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:14319:1874687715029760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787841979.037261:0:14319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.101@tcp lock: ffff92cbc149de00/0xe3dac0c99afff6f0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99afff6f7 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841979.037270:0:14319:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.101@tcp lock: ffff92cbc149de00/0xe3dac0c99afff6f0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe3dac0c99afff6f7 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841979.037323:0:14319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e66940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:14319:1874687715029888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787841979.037355:0:14319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841979.037390:0:14319:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbe9984300 going to sleep for 11 seconds 00000100:00100000:1.0:1787841979.037531:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715029888 00000100:00100000:1.0:1787841979.037536:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715029888 00000100:00100000:1.0:1787841979.037563:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787841979.037571:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cc01d22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+19:14319:x1874687715029888:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787841979.037971:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cc01d22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+19:14319:x1874687715029888:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 400us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841979.037979:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787841979.038197:0:14319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e66940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:14319:1874687715029888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787841979.038235:0:14319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e66940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:14319:1874687715030016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787841979.038276:0:14319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841979.038309:0:14319:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbe9984300 going to sleep for 11 seconds 00000100:00100000:1.0:1787841979.038865:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715030016 00000100:00100000:1.0:1787841979.038881:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715030016 00000100:00100000:1.0:1787841979.039131:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1787841979.039141:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe9839850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+19:14319:x1874687715030016:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787841979.039328:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe9839850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+19:14319:x1874687715030016:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 188us (1050us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841979.039335:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1787841979.039469:0:14319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e66940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:14319:1874687715030016:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787841979.045562:0:16511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1787841979.045910:0:14319:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1787841979.045944:0:14319:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787841979.045955:0:14319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.101@tcp lock: ffff92cbc149de00/0xe3dac0c99afff6f0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99afff6f7 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841979.045967:0:14319:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.101@tcp lock: ffff92cbc149de00/0xe3dac0c99afff6f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe3dac0c99afff6f7 expref: -99 pid: 14319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841979.086838:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841979.087210:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695111680 00000100:00100000:0.0:1787841979.087221:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695111680 00000100:00100000:0.0:1787841979.087286:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 116 00000100:00100000:0.0:1787841979.087313:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe9838850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34e5681c-63ea-4fb9-89c0-59dcf324dc9b+11:13767:x1874687695111680:12345-192.168.201.1@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787841979.087332:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841979.087351:0:14315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92cbc6725400/0xe3dac0c99afff6fe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6c57 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841979.087380:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92cbc6725400/0xe3dac0c99afff6fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6c57 expref: 12 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841979.087391:0:14315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92cbc6725400/0xe3dac0c99afff6fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6c57 expref: 12 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841979.087400:0:14315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc6725400, rc 0) 00000100:00100000:0.0:1787841979.087606:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe9838850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34e5681c-63ea-4fb9-89c0-59dcf324dc9b+12:13767:x1874687695111680:12345-192.168.201.1@tcp:101:ll_cfg_requeue.0 Request processed in 295us (777us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841979.087613:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 116 00000100:00100000:1.0:1787841979.101611:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841979.103673:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695111808 00000100:00100000:0.0:1787841979.103689:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695111808 00000100:00100000:0.0:1787841979.104352:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 117 00000100:00100000:0.0:1787841979.104363:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe983bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34e5681c-63ea-4fb9-89c0-59dcf324dc9b+12:13767:x1874687695111808:12345-192.168.201.1@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787841979.104669:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe983bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34e5681c-63ea-4fb9-89c0-59dcf324dc9b+12:13767:x1874687695111808:12345-192.168.201.1@tcp:501:ll_cfg_requeue.0 Request processed in 307us (3068us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841979.104678:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 117 00000100:00100000:0.0:1787841979.113649:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841979.113742:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695111936 00000100:00100000:3.0:1787841979.113751:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695111936 00000100:00100000:3.0:1787841979.113798:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 118 00000100:00100000:3.0:1787841979.113806:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe9838450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34e5681c-63ea-4fb9-89c0-59dcf324dc9b+12:13767:x1874687695111936:12345-192.168.201.1@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787841979.114022:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe9838450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34e5681c-63ea-4fb9-89c0-59dcf324dc9b+12:13767:x1874687695111936:12345-192.168.201.1@tcp:503:ll_cfg_requeue.0 Request processed in 216us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841979.114030:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 118 00000100:00100000:2.0:1787841979.137807:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841979.138032:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695112064 00000100:00100000:1.0:1787841979.138042:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695112064 00000100:00100000:1.0:1787841979.138089:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 119 00000100:00100000:1.0:1787841979.138097:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe7e2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34e5681c-63ea-4fb9-89c0-59dcf324dc9b+12:13767:x1874687695112064:12345-192.168.201.1@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787841979.138113:0:14316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841979.138132:0:14316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92cac3331a00/0xe3dac0c99afff705 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6c5e expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841979.138160:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92cac3331a00/0xe3dac0c99afff705 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6c5e expref: 13 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841979.138172:0:14316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92cac3331a00/0xe3dac0c99afff705 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6c5e expref: 13 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841979.138182:0:14316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cac3331a00, rc 0) 00000100:00100000:1.0:1787841979.138232:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe7e2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34e5681c-63ea-4fb9-89c0-59dcf324dc9b+13:13767:x1874687695112064:12345-192.168.201.1@tcp:101:ll_cfg_requeue.0 Request processed in 136us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841979.138239:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 119 00000100:00100000:2.0:1787841979.153657:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841979.154119:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695112192 00000100:00100000:3.0:1787841979.154128:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695112192 00000100:00100000:3.0:1787841979.154185:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 120 00000100:00100000:3.0:1787841979.154195:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe7e2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34e5681c-63ea-4fb9-89c0-59dcf324dc9b+13:13767:x1874687695112192:12345-192.168.201.1@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787841979.154481:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe7e2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34e5681c-63ea-4fb9-89c0-59dcf324dc9b+13:13767:x1874687695112192:12345-192.168.201.1@tcp:501:ll_cfg_requeue.0 Request processed in 286us (833us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841979.154495:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 120 00000100:00100000:0.0:1787841979.167907:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841979.168230:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695112320 00000100:00100000:1.0:1787841979.168242:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695112320 00000100:00100000:1.0:1787841979.168305:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 121 00000100:00100000:1.0:1787841979.168324:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe7e2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34e5681c-63ea-4fb9-89c0-59dcf324dc9b+13:13767:x1874687695112320:12345-192.168.201.1@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787841979.168533:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe7e2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34e5681c-63ea-4fb9-89c0-59dcf324dc9b+13:13767:x1874687695112320:12345-192.168.201.1@tcp:503:ll_cfg_requeue.0 Request processed in 211us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841979.168541:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 121 00000100:00100000:1.0:1787841979.553538:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841979.553583:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841979.553613:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841979.553634:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841979.553655:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841979.553678:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841979.553727:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695112448 00000100:00100000:1.0:1787841979.553737:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695112448 00000100:00100000:1.0:1787841979.553813:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695112832 00000100:00100000:1.0:1787841979.553816:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695112832 00000100:00100000:1.0:1787841979.553839:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 26 00000100:00100000:1.0:1787841979.553848:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff4d6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d29cd7d6-5033-4a84-a074-c74886c050cd+6:2357:x1874687695112448:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:1.0:1787841979.553935:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff4d6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d29cd7d6-5033-4a84-a074-c74886c050cd+6:2357:x1874687695112448:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 77us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841979.553944:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 26 00000100:00100000:1.0:1787841979.553961:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 27 00000100:00100000:1.0:1787841979.553967:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff4d5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d176eb3a-a183-4a09-a413-a2a087378ac7+6:2357:x1874687695112832:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:1.0:1787841979.553990:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff4d5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d176eb3a-a183-4a09-a413-a2a087378ac7+6:2357:x1874687695112832:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 23us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841979.553995:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 27 00000100:00100000:1.0:1787841979.554012:0:16199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695112704 00000100:00100000:1.0:1787841979.554016:0:16199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695112704 00000100:00100000:1.0:1787841979.554048:0:16199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695112960 00000100:00100000:1.0:1787841979.554051:0:16199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695112960 00000100:00100000:1.0:1787841979.554061:0:16199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695112576 00000100:00100000:1.0:1787841979.554064:0:16199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695112576 00000100:00100000:1.0:1787841979.554075:0:16199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695113088 00000100:00100000:1.0:1787841979.554078:0:16199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695113088 00000100:00100000:1.0:1787841979.554090:0:16199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 14 00000100:00100000:1.0:1787841979.554096:0:16199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff4d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d29cd7d6-5033-4a84-a074-c74886c050cd+5:2357:x1874687695112704:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:1.0:1787841979.554123:0:16199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff4d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d29cd7d6-5033-4a84-a074-c74886c050cd+5:2357:x1874687695112704:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 28us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841979.554129:0:16199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 14 00000100:00100000:1.0:1787841979.554141:0:16199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 15 00000100:00100000:1.0:1787841979.554147:0:16199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff4d6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d176eb3a-a183-4a09-a413-a2a087378ac7+5:2357:x1874687695112960:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:1.0:1787841979.554167:0:16199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff4d6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d176eb3a-a183-4a09-a413-a2a087378ac7+5:2357:x1874687695112960:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 20us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841979.554173:0:16199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 15 00000100:00100000:1.0:1787841979.554183:0:16199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 16 00000100:00100000:1.0:1787841979.554189:0:16199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff4d43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d29cd7d6-5033-4a84-a074-c74886c050cd+5:2357:x1874687695112576:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:1.0:1787841979.554208:0:16199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff4d43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d29cd7d6-5033-4a84-a074-c74886c050cd+5:2357:x1874687695112576:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 20us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841979.554215:0:16199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 16 00000100:00100000:1.0:1787841979.554224:0:16199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 17 00000100:00100000:1.0:1787841979.554230:0:16199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff4d5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d176eb3a-a183-4a09-a413-a2a087378ac7+5:2357:x1874687695113088:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:1.0:1787841979.554251:0:16199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff4d5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d176eb3a-a183-4a09-a413-a2a087378ac7+5:2357:x1874687695113088:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 20us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841979.554267:0:16199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 17 00000100:00080000:1.0:1787841979.554294:0:14318:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787841979.554437:0:14318:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787841979.554440:0:14318:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787841980.033167:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787841980.162812:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff4d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687715030144:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787841980.162909:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841980.163209:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715030144 00000100:00100000:1.0:1787841980.163219:0:15008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715030144 00000100:00100000:1.0:1787841980.163293:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787841980.163302:0:15008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cc00ddd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874687715030144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787841980.163339:0:15008:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787841980.163385:0:15008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cc00ddd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874687715030144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841980.163392:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787841980.163445:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff4d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687715030144:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787841980.164137:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac26dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874687715030400:0@lo:400:kworker.0 00000100:00100000:0.0:1787841980.164180:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841980.164224:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787841980.164231:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac26de1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874687715030528:0@lo:400:kworker.0 00000100:00100000:0.0:1787841980.164264:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787841980.164345:0:14318:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787841980.164406:0:16199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715030400 00000100:00100000:1.0:1787841980.164412:0:16199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715030400 00000100:00100000:1.0:1787841980.164468:0:16199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787841980.164478:0:16199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac26dcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1874687715030400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841980.164526:0:16199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac26dcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1874687715030400:12345-0@lo:400:kworker.0 Request processed in 50us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841980.164534:0:16199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787841980.164554:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715030528 00000100:00100000:1.0:1787841980.164558:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715030528 00000100:00100000:1.0:1787841980.164584:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787841980.164590:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac1115a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874687715030528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841980.164622:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac1115a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874687715030528:12345-0@lo:400:kworker.0 Request processed in 32us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841980.164638:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787841980.164674:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac26de1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874687715030528:0@lo:400:kworker.0 00000100:00100000:1.0:1787841980.164685:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac26dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874687715030400:0@lo:400:kworker.0 00000100:00100000:1.0:1787841980.164733:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac26dd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1874687715030656:0@lo:400:kworker.0 00000100:00100000:1.0:1787841980.164760:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841980.164780:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787841980.164786:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac26dcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:3298:1874687715030272:0@lo:400:kworker.0 00000100:00080000:2.0:1787841980.164902:0:14318:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787841980.164939:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715030656 00000100:00100000:2.0:1787841980.164944:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715030656 00000100:00100000:2.0:1787841980.164989:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787841980.164996:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff4d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1874687715030656:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787841980.165173:0:14318:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787841980.169075:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841980.169209:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac26dda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1874687715030784:0@lo:400:kworker.0 00000100:00100000:1.0:1787841980.169254:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787841980.169652:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff4d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1874687715030656:12345-0@lo:400:kworker.0 Request processed in 4654us (4888us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841980.169663:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787841980.169734:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715030784 00000100:00100000:2.0:1787841980.169743:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715030784 00000100:00100000:1.0:1787841980.169851:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac26dd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1874687715030656:0@lo:400:kworker.0 00000100:00080000:1.0:1787841980.169906:0:14318:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787841980.170548:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787841980.170564:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff4d7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1874687715030784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841980.170643:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff4d7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1874687715030784:12345-0@lo:400:kworker.0 Request processed in 84us (1388us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841980.170652:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787841980.170739:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac26dda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1874687715030784:0@lo:400:kworker.0 00000100:00100000:3.0:1787841980.170865:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715030272 00000100:00100000:3.0:1787841980.171103:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715030272 00000100:00100000:1.0:1787841980.175319:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1787841980.175346:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe7e2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+19:3298:x1874687715030272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841980.175547:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe7e2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+19:3298:x1874687715030272:12345-0@lo:400:kworker.0 Request processed in 214us (6479us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841980.175556:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1787841980.178505:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac26dcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:3298:1874687715030272:0@lo:400:kworker.0 00010000:00010000:1.0:1787841981.058084:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787841981.297368:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841981.297500:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695113216 00000100:00100000:1.0:1787841981.297513:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695113216 00000100:00100000:1.0:1787841981.297608:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 15 00000100:00100000:1.0:1787841981.297621:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac1114780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d29cd7d6-5033-4a84-a074-c74886c050cd+6:14423:x1874687695113216:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787841981.297669:0:14323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:3.0:1787841981.297770:0:14318:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787841981.297863:0:14323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331400/0xe3dac0c99afff70c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6c65 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.298227:0:14323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3330600/0xe3dac0c99afff713 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.298247:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3330600/0xe3dac0c99afff713 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.298262:0:14323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3330600/0xe3dac0c99afff713 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.298280:0:14323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3330400/0xe3dac0c99afff71a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.298287:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3330400/0xe3dac0c99afff71a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.298294:0:14323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3330400/0xe3dac0c99afff71a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.301327:0:14323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331e00/0xe3dac0c99afff721 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.301357:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331e00/0xe3dac0c99afff721 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.301372:0:14323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331e00/0xe3dac0c99afff721 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787841981.301471:0:14323:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1787841981.301481:0:14323:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1787841981.301578:0:14323:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331e00/0xe3dac0c99afff721 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.301593:0:14323:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3330600/0xe3dac0c99afff713 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.301600:0:14323:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3330600/0xe3dac0c99afff713 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.301608:0:14323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3330600/0xe3dac0c99afff713 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.301615:0:14323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cac3330600 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:1.0:1787841981.301619:0:14323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3330600/0xe3dac0c99afff713 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.301628:0:14323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3330600/0xe3dac0c99afff713 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.301642:0:14323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92cbcd829500) 00010000:00010000:1.0:1787841981.301645:0:14323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787841981.301650:0:14323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3330600/0xe3dac0c99afff713 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.301657:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3330600/0xe3dac0c99afff713 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.301687:0:14323:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3330400/0xe3dac0c99afff71a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.301693:0:14323:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3330400/0xe3dac0c99afff71a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.301763:0:14323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3330400/0xe3dac0c99afff71a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.301769:0:14323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cac3330400 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:1.0:1787841981.301773:0:14323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3330400/0xe3dac0c99afff71a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.301779:0:14323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3330400/0xe3dac0c99afff71a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.301787:0:14323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff92cbcd829100) 00010000:00010000:1.0:1787841981.301789:0:14323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787841981.301792:0:14323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3330400/0xe3dac0c99afff71a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.301799:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3330400/0xe3dac0c99afff71a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.301849:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331400/0xe3dac0c99afff70c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6c65 expref: 8 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.301862:0:14323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331e00/0xe3dac0c99afff721 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6c65 expref: 7 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.301878:0:14323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff92cbcd829700) 00010000:00010000:1.0:1787841981.301880:0:14323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787841981.301883:0:14323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cac3331e00, rc 0) 00000100:00100000:1.0:1787841981.301991:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac1114780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d29cd7d6-5033-4a84-a074-c74886c050cd+7:14423:x1874687695113216:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 Request processed in 4372us (4637us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841981.302010:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 15 00000100:00100000:1.0:1787841981.315425:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841981.315497:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695113472 00000100:00100000:3.0:1787841981.315508:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695113472 00000100:00100000:3.0:1787841981.315574:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 16 00000100:00100000:3.0:1787841981.315582:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac26dcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d29cd7d6-5033-4a84-a074-c74886c050cd+7:14423:x1874687695113472:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787841981.315610:0:14322:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841981.315637:0:14322:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149cc00/0xe3dac0c99afff728 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6c6c expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841981.315760:0:14322:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99afff72f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841981.315778:0:14322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99afff72f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841981.315792:0:14322:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99afff72f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841981.315810:0:14322:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149ce00/0xe3dac0c99afff736 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841981.315817:0:14322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149ce00/0xe3dac0c99afff736 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841981.315824:0:14322:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149ce00/0xe3dac0c99afff736 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841981.316427:0:14322:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99afff73d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841981.316436:0:14322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99afff73d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841981.316442:0:14322:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99afff73d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787841981.316450:0:14322:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1787841981.316727:0:14322:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99afff72f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841981.316736:0:14322:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99afff72f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841981.316744:0:14322:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99afff72f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841981.316750:0:14322:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc149c000 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:3.0:1787841981.316756:0:14322:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99afff72f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841981.316765:0:14322:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99afff72f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841981.316779:0:14322:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff92cbcd829700) 00010000:00010000:3.0:1787841981.316783:0:14322:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787841981.316789:0:14322:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99afff72f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841981.316807:0:14322:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99afff72f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841981.316823:0:14322:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149ce00/0xe3dac0c99afff736 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841981.316830:0:14322:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149ce00/0xe3dac0c99afff736 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841981.316835:0:14322:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149ce00/0xe3dac0c99afff736 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841981.316840:0:14322:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc149ce00 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:3.0:1787841981.316844:0:14322:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149ce00/0xe3dac0c99afff736 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841981.316850:0:14322:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149ce00/0xe3dac0c99afff736 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841981.316859:0:14322:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff92cbc89cd200) 00010000:00010000:3.0:1787841981.316861:0:14322:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787841981.316864:0:14322:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149ce00/0xe3dac0c99afff736 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841981.316870:0:14322:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149ce00/0xe3dac0c99afff736 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841981.317343:0:14322:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149cc00/0xe3dac0c99afff728 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6c6c expref: 10 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841981.317366:0:14322:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149d600/0xe3dac0c99afff73d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6c6c expref: 9 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841981.317371:0:14322:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff92cbc89cda00) 00010000:00010000:3.0:1787841981.317373:0:14322:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787841981.317375:0:14322:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc149d600, rc 0) 00000100:00100000:3.0:1787841981.317455:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac26dcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d29cd7d6-5033-4a84-a074-c74886c050cd+9:14423:x1874687695113472:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 Request processed in 1874us (2042us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1787841981.317462:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 16 00000100:00100000:3.0:1787841981.324134:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841981.324218:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695113600 00000100:00100000:1.0:1787841981.324231:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695113600 00000100:00100000:1.0:1787841981.324312:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 17 00000100:00100000:1.0:1787841981.324324:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e66940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d29cd7d6-5033-4a84-a074-c74886c050cd+9:14423:x1874687695113600:12345-192.168.201.1@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1787841981.324455:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e66940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d29cd7d6-5033-4a84-a074-c74886c050cd+9:14423:x1874687695113600:12345-192.168.201.1@tcp:59:lhsmtool_posix.0 Request processed in 135us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841981.324461:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 17 00000100:00100000:3.0:1787841981.357821:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841981.357964:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695113728 00000100:00100000:1.0:1787841981.357988:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695113728 00000100:00100000:1.0:1787841981.358073:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 18 00000100:00100000:1.0:1787841981.358085:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e64f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d29cd7d6-5033-4a84-a074-c74886c050cd+9:14429:x1874687695113728:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:1.0:1787841981.358116:0:14324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841981.358142:0:14324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331400/0xe3dac0c99afff74b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6c73 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.358228:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3330400/0xe3dac0c99afff752 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.358246:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3330400/0xe3dac0c99afff752 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.358258:0:14324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3330400/0xe3dac0c99afff752 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.358276:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3330600/0xe3dac0c99afff759 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.358300:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3330600/0xe3dac0c99afff759 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.358308:0:14324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3330600/0xe3dac0c99afff759 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.358600:0:14324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3330400/0xe3dac0c99afff752 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.358609:0:14324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3330400/0xe3dac0c99afff752 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.358616:0:14324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3330400/0xe3dac0c99afff752 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.358622:0:14324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cac3330400 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:1.0:1787841981.358627:0:14324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3330400/0xe3dac0c99afff752 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.358634:0:14324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3330400/0xe3dac0c99afff752 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.358648:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92cbcd829500) 00010000:00010000:1.0:1787841981.358652:0:14324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787841981.358658:0:14324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3330400/0xe3dac0c99afff752 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.358665:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3330400/0xe3dac0c99afff752 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.358761:0:14324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3330600/0xe3dac0c99afff759 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.358777:0:14324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3330600/0xe3dac0c99afff759 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.358783:0:14324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3330600/0xe3dac0c99afff759 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.358789:0:14324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cac3330600 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:1.0:1787841981.358792:0:14324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3330600/0xe3dac0c99afff759 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.358798:0:14324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3330600/0xe3dac0c99afff759 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.358807:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff92cbcd829100) 00010000:00010000:1.0:1787841981.358809:0:14324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787841981.358812:0:14324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3330600/0xe3dac0c99afff759 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.358819:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3330600/0xe3dac0c99afff759 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.358860:0:14324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331400/0xe3dac0c99afff74b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6c73 expref: 10 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.358873:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92cbcd829500) 00010000:00010000:1.0:1787841981.358876:0:14324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787841981.358880:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331400/0xe3dac0c99afff74b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6c73 expref: 10 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.358913:0:14324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cac3331400, rc 0) 00000100:00100000:1.0:1787841981.358996:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e64f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d29cd7d6-5033-4a84-a074-c74886c050cd+9:14429:x1874687695113728:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 913us (1191us total) trans 0 rc 301/301 00000100:00100000:1.0:1787841981.359006:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 18 00000100:00100000:0.0:1787841981.367681:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841981.367920:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695113856 00000100:00100000:1.0:1787841981.367934:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695113856 00000100:00100000:1.0:1787841981.368000:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 0 00000100:00100000:1.0:1787841981.368012:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac1116580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:d29cd7d6-5033-4a84-a074-c74886c050cd+9:14429:x1874687695113856:12345-192.168.201.1@tcp:700:lfs.0 00000100:00100000:1.0:1787841981.368128:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac1116580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:d29cd7d6-5033-4a84-a074-c74886c050cd+9:14429:x1874687695113856:12345-192.168.201.1@tcp:700:lfs.0 Request processed in 118us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841981.368137:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 0 00000100:00100000:3.0:1787841981.371177:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841981.371335:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695114112 00000100:00100000:1.0:1787841981.371349:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695114112 00000100:00100000:1.0:1787841981.371535:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 19 00000100:00100000:1.0:1787841981.371546:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d29cd7d6-5033-4a84-a074-c74886c050cd+9:14429:x1874687695114112:12345-192.168.201.1@tcp:36:lfs.0 00010000:00010000:1.0:1787841981.371624:0:14322:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787841981.371661:0:14322:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331000/0xe3dac0c99afff68e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6bee expref: 9 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.371755:0:14322:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92cbcd829500) 00010000:00010000:1.0:1787841981.371763:0:14322:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787841981.372114:0:14322:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331400/0xe3dac0c99afff760 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.372131:0:14322:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105c00/0xe3dac0c99afff6c6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6c50 expref: 5 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.372151:0:14322:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331400/0xe3dac0c99afff760 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.372197:0:14322:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105c00/0xe3dac0c99afff6c6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6c50 expref: 5 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.372212:0:14322:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105c00/0xe3dac0c99afff6c6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6c50 expref: 5 pid: 14323 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841981.372229:0:14322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac26dda40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14322:1874687715030912:192.168.201.1@tcp:104: 00000100:00100000:1.0:1787841981.372349:0:14322:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbe0b6a180 going to sleep for 11 seconds 00000100:00100000:3.0:1787841981.381940:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841981.381989:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695114240 00000100:00100000:3.0:1787841981.382001:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695114240 00010000:00010000:3.0:1787841981.382072:0:14308:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105c00/0xe3dac0c99afff6c6 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6c50 expref: 6 pid: 14323 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841981.382117:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 9 00000100:00100000:3.0:1787841981.382129:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e652c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d176eb3a-a183-4a09-a413-a2a087378ac7+6:2357:x1874687695114240:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787841981.382150:0:14308:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787841981.382157:0:14308:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105c00/0xe3dac0c99afff6c6 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6c50 expref: 6 pid: 14323 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841981.382173:0:14308:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105c00/0xe3dac0c99afff6c6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6c50 expref: 6 pid: 14323 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841981.382227:0:14308:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92cbcd829500) 00010000:00010000:3.0:1787841981.382233:0:14308:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331400/0xe3dac0c99afff760 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841981.382244:0:14308:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331400/0xe3dac0c99afff760 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841981.382254:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331400/0xe3dac0c99afff760 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841981.382276:0:14308:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787841981.382342:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e652c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d176eb3a-a183-4a09-a413-a2a087378ac7+6:2357:x1874687695114240:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 214us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841981.382351:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 9 00000100:00080000:3.0:1787841981.382384:0:14318:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787841981.382669:0:14322:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105c00/0xe3dac0c99afff6c6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6c50 expref: 5 pid: 14323 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841981.382690:0:14322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac26dda40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14322:1874687715030912:192.168.201.1@tcp:104: 00010000:00010000:2.0:1787841981.382765:0:14322:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331400/0xe3dac0c99afff760 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.382777:0:14322:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331400/0xe3dac0c99afff760 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.382783:0:14322:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331400/0xe3dac0c99afff760 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.382811:0:14322:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105200/0xe3dac0c99afff767 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.382822:0:14322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105200/0xe3dac0c99afff767 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.382831:0:14322:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105200/0xe3dac0c99afff767 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787841981.384490:0:14322:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1787841981.384512:0:14322:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331400/0xe3dac0c99afff760 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.384524:0:14322:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331400/0xe3dac0c99afff760 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.384533:0:14322:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331400/0xe3dac0c99afff760 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.384548:0:14322:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cac3331400 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:2.0:1787841981.384554:0:14322:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331400/0xe3dac0c99afff760 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.384563:0:14322:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331400/0xe3dac0c99afff760 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.384581:0:14322:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92cbcd829500) 00010000:00010000:2.0:1787841981.384584:0:14322:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787841981.384589:0:14322:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331400/0xe3dac0c99afff760 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.384596:0:14322:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331400/0xe3dac0c99afff760 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787841981.384638:0:14322:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000058b1fdf1 reply state 00000000f0dc08d9 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105200/0xe3dac0c99afff767 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841981.384647:0:14322:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787841981.384821:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d29cd7d6-5033-4a84-a074-c74886c050cd+10:14429:x1874687695114112:12345-192.168.201.1@tcp:36:lfs.0 Request processed in 13270us (13651us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1787841981.384831:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 19 00010000:00010000:3.0:1787841981.387847:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105200/0xe3dac0c99afff767 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841981.387870:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105200/0xe3dac0c99afff767 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841981.387880:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105200/0xe3dac0c99afff767 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841981.387887:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6105200 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:3.0:1787841981.387892:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105200/0xe3dac0c99afff767 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841981.387910:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105200/0xe3dac0c99afff767 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841981.388416:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff92cbc3b04800) 00010000:00010000:3.0:1787841981.388420:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787841981.388427:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105200/0xe3dac0c99afff767 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841981.388433:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105200/0xe3dac0c99afff767 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841981.470608:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841981.470736:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695114368 00000100:00100000:0.0:1787841981.470750:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695114368 00000100:00100000:0.0:1787841981.470829:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 20 00000100:00100000:0.0:1787841981.470847:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d29cd7d6-5033-4a84-a074-c74886c050cd+9:14437:x1874687695114368:12345-192.168.201.1@tcp:101:lctl.0 00010000:00010000:0.0:1787841981.470882:0:14323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841981.470931:0:14323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725000/0xe3dac0c99afff76e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6c7a expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841981.471028:0:14323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725e00/0xe3dac0c99afff775 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841981.471046:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725e00/0xe3dac0c99afff775 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841981.471061:0:14323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725e00/0xe3dac0c99afff775 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787841981.471171:0:14323:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787841981.471189:0:14323:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:0.0:1787841981.471245:0:14323:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725e00/0xe3dac0c99afff775 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841981.471273:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725000/0xe3dac0c99afff76e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6c7a expref: 11 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841981.471295:0:14323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725e00/0xe3dac0c99afff775 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6c7a expref: 10 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841981.471305:0:14323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92cbc57e3500) 00010000:00010000:0.0:1787841981.471308:0:14323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787841981.471313:0:14323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc6725e00, rc 0) 00000100:00100000:0.0:1787841981.471402:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d29cd7d6-5033-4a84-a074-c74886c050cd+10:14437:x1874687695114368:12345-192.168.201.1@tcp:101:lctl.0 Request processed in 562us (809us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841981.471410:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 20 00000100:00100000:0.0:1787841981.508398:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841981.509848:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695114496 00000100:00100000:2.0:1787841981.509882:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695114496 00000100:00100000:2.0:1787841981.509984:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 21 00000100:00100000:2.0:1787841981.509997:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac1117840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d176eb3a-a183-4a09-a413-a2a087378ac7+5:14438:x1874687695114496:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:2.0:1787841981.510028:0:14322:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841981.510058:0:14322:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105c00/0xe3dac0c99afff77c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6c81 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.510192:0:14322:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105200/0xe3dac0c99afff783 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.510209:0:14322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105200/0xe3dac0c99afff783 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.510222:0:14322:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105200/0xe3dac0c99afff783 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787841981.510307:0:14322:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787841981.510311:0:14322:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:2.0:1787841981.510340:0:14322:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105200/0xe3dac0c99afff783 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.510371:0:14322:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105c00/0xe3dac0c99afff77c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6c81 expref: 7 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.510395:0:14322:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105200/0xe3dac0c99afff783 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6c81 expref: 6 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.510405:0:14322:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92cbc57e3500) 00010000:00010000:2.0:1787841981.510408:0:14322:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787841981.510413:0:14322:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc6105200, rc 0) 00000100:00100000:2.0:1787841981.510506:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac1117840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d176eb3a-a183-4a09-a413-a2a087378ac7+6:14438:x1874687695114496:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 513us (2123us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841981.510515:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 21 00000100:00100000:1.0:1787841981.519602:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841981.520009:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695114624 00000100:00100000:2.0:1787841981.520024:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695114624 00000100:00100000:2.0:1787841981.520194:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 22 00000100:00100000:2.0:1787841981.520207:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac26dd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d176eb3a-a183-4a09-a413-a2a087378ac7+6:14438:x1874687695114624:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:2.0:1787841981.520240:0:14324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841981.520268:0:14324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105c00/0xe3dac0c99afff78a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6c88 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.520359:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105400/0xe3dac0c99afff791 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.520377:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105400/0xe3dac0c99afff791 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.520391:0:14324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105400/0xe3dac0c99afff791 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.520410:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104400/0xe3dac0c99afff798 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.520416:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104400/0xe3dac0c99afff798 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.520423:0:14324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104400/0xe3dac0c99afff798 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.520551:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104200/0xe3dac0c99afff79f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.520559:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104200/0xe3dac0c99afff79f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.520565:0:14324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104200/0xe3dac0c99afff79f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787841981.520639:0:14324:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1787841981.520644:0:14324:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787841981.520673:0:14324:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104200/0xe3dac0c99afff79f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.520782:0:14324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105400/0xe3dac0c99afff791 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.520790:0:14324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105400/0xe3dac0c99afff791 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.520798:0:14324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105400/0xe3dac0c99afff791 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.520805:0:14324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6105400 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:2.0:1787841981.520810:0:14324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105400/0xe3dac0c99afff791 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.520819:0:14324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105400/0xe3dac0c99afff791 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.520834:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92cbc57e3500) 00010000:00010000:2.0:1787841981.520837:0:14324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787841981.520842:0:14324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105400/0xe3dac0c99afff791 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.520848:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105400/0xe3dac0c99afff791 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.520864:0:14324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104400/0xe3dac0c99afff798 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.520963:0:14324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104400/0xe3dac0c99afff798 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.520969:0:14324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104400/0xe3dac0c99afff798 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.520974:0:14324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6104400 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:2.0:1787841981.520978:0:14324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104400/0xe3dac0c99afff798 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.520984:0:14324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104400/0xe3dac0c99afff798 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.520992:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff92cbc3b04900) 00010000:00010000:2.0:1787841981.520994:0:14324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787841981.520997:0:14324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104400/0xe3dac0c99afff798 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.521003:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104400/0xe3dac0c99afff798 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.521042:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105c00/0xe3dac0c99afff78a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6c88 expref: 8 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.521058:0:14324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104200/0xe3dac0c99afff79f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6c88 expref: 7 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.521065:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff92cbc3b04500) 00010000:00010000:2.0:1787841981.521068:0:14324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787841981.521076:0:14324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc6104200, rc 0) 00000100:00100000:2.0:1787841981.521165:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac26dd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d176eb3a-a183-4a09-a413-a2a087378ac7+7:14438:x1874687695114624:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 961us (1579us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841981.521173:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 22 00000100:00100000:3.0:1787841981.526299:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841981.526622:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695114880 00000100:00100000:2.0:1787841981.526637:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695114880 00000100:00100000:2.0:1787841981.527043:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 23 00000100:00100000:2.0:1787841981.527057:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d176eb3a-a183-4a09-a413-a2a087378ac7+7:14438:x1874687695114880:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:2.0:1787841981.527089:0:14322:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841981.527115:0:14322:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105c00/0xe3dac0c99afff7a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6c8f expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787841981.527295:0:14322:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1787841981.527641:0:14322:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105c00/0xe3dac0c99afff7a6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6c8f expref: 9 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.527660:0:14322:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92cbc57e3500) 00010000:00010000:2.0:1787841981.527663:0:14322:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787841981.527670:0:14322:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105c00/0xe3dac0c99afff7a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6c8f expref: 9 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.527686:0:14322:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc6105c00, rc 0) 00000100:00100000:2.0:1787841981.527857:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d176eb3a-a183-4a09-a413-a2a087378ac7+8:14438:x1874687695114880:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 803us (1572us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1787841981.527865:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 23 00000100:00100000:3.0:1787841981.534862:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841981.535134:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695115136 00000100:00100000:2.0:1787841981.535148:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695115136 00000100:00100000:2.0:1787841981.535273:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 24 00000100:00100000:2.0:1787841981.535307:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e670c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d176eb3a-a183-4a09-a413-a2a087378ac7+8:14438:x1874687695115136:12345-192.168.201.1@tcp:36:lfs.0 00010000:00010000:2.0:1787841981.535391:0:14324:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787841981.535429:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104200/0xe3dac0c99afff79f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6c88 expref: 8 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.535454:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff92cbc3b04500) 00010000:00010000:2.0:1787841981.535467:0:14324:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787841981.535499:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104400/0xe3dac0c99afff7b4 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.535515:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104400/0xe3dac0c99afff7b4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.535529:0:14324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104400/0xe3dac0c99afff7b4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787841981.537842:0:14324:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000091165185 reply state 0000000072bf2211 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104400/0xe3dac0c99afff7b4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841981.537978:0:14324:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787841981.538014:0:14324:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:2.0:1787841981.538207:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e670c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d176eb3a-a183-4a09-a413-a2a087378ac7+9:14438:x1874687695115136:12345-192.168.201.1@tcp:36:lfs.0 Request processed in 2900us (3358us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1787841981.538217:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 24 00010000:00010000:1.0:1787841981.540414:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104400/0xe3dac0c99afff7b4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.540437:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104400/0xe3dac0c99afff7b4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.540447:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104400/0xe3dac0c99afff7b4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.540453:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6104400 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:1.0:1787841981.540459:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104400/0xe3dac0c99afff7b4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.540469:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104400/0xe3dac0c99afff7b4 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841981.540476:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00010000:00010000:1.0:1787841981.540492:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff92cbc3b04900) 00010000:00010000:1.0:1787841981.540514:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1787841981.540521:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104400/0xe3dac0c99afff7b4 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.540528:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104400/0xe3dac0c99afff7b4 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841981.540595:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695115392 00000100:00100000:0.0:1787841981.540608:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695115392 00000100:00100000:0.0:1787841981.540797:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 2 00000100:00100000:0.0:1787841981.540810:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e67c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d176eb3a-a183-4a09-a413-a2a087378ac7+8:14438:x1874687695115392:12345-192.168.201.1@tcp:35:lfs.0 00000100:00100000:0.0:1787841981.541182:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e67c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d176eb3a-a183-4a09-a413-a2a087378ac7+9:14438:x1874687695115392:12345-192.168.201.1@tcp:35:lfs.0 Request processed in 373us (707us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1787841981.541192:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 2 00000100:00100000:3.0:1787841981.543516:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841981.543606:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695115648 00000100:00100000:2.0:1787841981.543617:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695115648 00000100:00100000:2.0:1787841981.543731:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 25 00000100:00100000:2.0:1787841981.543743:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e65e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d176eb3a-a183-4a09-a413-a2a087378ac7+9:14438:x1874687695115648:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:2.0:1787841981.543773:0:14322:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841981.543816:0:14322:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105c00/0xe3dac0c99afff7bb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6c96 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.543943:0:14322:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105400/0xe3dac0c99afff7c2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.543961:0:14322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105400/0xe3dac0c99afff7c2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.543975:0:14322:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105400/0xe3dac0c99afff7c2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.543992:0:14322:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104600/0xe3dac0c99afff7c9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.543999:0:14322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104600/0xe3dac0c99afff7c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.544007:0:14322:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104600/0xe3dac0c99afff7c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787841981.544174:0:14322:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1787841981.544299:0:14322:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105400/0xe3dac0c99afff7c2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.544307:0:14322:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105400/0xe3dac0c99afff7c2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.544314:0:14322:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105400/0xe3dac0c99afff7c2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.544321:0:14322:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6105400 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:2.0:1787841981.544326:0:14322:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105400/0xe3dac0c99afff7c2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.544343:0:14322:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105400/0xe3dac0c99afff7c2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.544358:0:14322:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92cbc57e3500) 00010000:00010000:2.0:1787841981.544361:0:14322:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787841981.544368:0:14322:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105400/0xe3dac0c99afff7c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.544374:0:14322:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105400/0xe3dac0c99afff7c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.544390:0:14322:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104600/0xe3dac0c99afff7c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.544396:0:14322:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104600/0xe3dac0c99afff7c9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.544401:0:14322:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104600/0xe3dac0c99afff7c9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.544405:0:14322:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6104600 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:2.0:1787841981.544408:0:14322:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104600/0xe3dac0c99afff7c9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.544413:0:14322:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104600/0xe3dac0c99afff7c9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.544419:0:14322:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff92cbc3b04b00) 00010000:00010000:2.0:1787841981.544422:0:14322:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787841981.544424:0:14322:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104600/0xe3dac0c99afff7c9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.544438:0:14322:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104600/0xe3dac0c99afff7c9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.544491:0:14322:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105c00/0xe3dac0c99afff7bb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6c96 expref: 11 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.544503:0:14322:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92cbc57e3500) 00010000:00010000:2.0:1787841981.544505:0:14322:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787841981.544508:0:14322:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105c00/0xe3dac0c99afff7bb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6c96 expref: 11 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.544517:0:14322:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc6105c00, rc 0) 00000100:00100000:2.0:1787841981.544587:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e65e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d176eb3a-a183-4a09-a413-a2a087378ac7+10:14438:x1874687695115648:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 846us (1083us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1787841981.544594:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 25 00000100:00100000:3.0:1787841981.547616:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841981.547835:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695115776 00000100:00100000:2.0:1787841981.547850:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695115776 00000100:00100000:2.0:1787841981.548080:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 26 00000100:00100000:2.0:1787841981.548092:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e65a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d176eb3a-a183-4a09-a413-a2a087378ac7+10:14438:x1874687695115776:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:2.0:1787841981.548132:0:14324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841981.548169:0:14324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104000/0xe3dac0c99afff7d7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6c9d expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.548301:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104e00/0xe3dac0c99afff7de lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.548320:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104e00/0xe3dac0c99afff7de lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.548352:0:14324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104e00/0xe3dac0c99afff7de lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787841981.548417:0:14324:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1787841981.548423:0:14324:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787841981.548451:0:14324:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104e00/0xe3dac0c99afff7de lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.548485:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104000/0xe3dac0c99afff7d7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6c9d expref: 12 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.548506:0:14324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104e00/0xe3dac0c99afff7de lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6c9d expref: 11 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.548515:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff92cbc3b04400) 00010000:00010000:2.0:1787841981.548518:0:14324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787841981.548522:0:14324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc6104e00, rc 0) 00000100:00100000:2.0:1787841981.548653:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e65a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d176eb3a-a183-4a09-a413-a2a087378ac7+11:14438:x1874687695115776:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 564us (1057us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841981.548661:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 26 00000100:00100000:3.0:1787841981.552124:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841981.552258:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695115904 00000100:00100000:2.0:1787841981.552271:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695115904 00000100:00100000:2.0:1787841981.552434:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 3 00000100:00100000:2.0:1787841981.552447:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e67840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d176eb3a-a183-4a09-a413-a2a087378ac7+11:14438:x1874687695115904:12345-192.168.201.1@tcp:37:lfs.0 00000100:00100000:2.0:1787841981.564504:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e67840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d176eb3a-a183-4a09-a413-a2a087378ac7+11:14438:x1874687695115904:12345-192.168.201.1@tcp:37:lfs.0 Request processed in 12041us (12377us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841981.564521:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 3 00000100:00100000:3.0:1787841981.572036:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000040:00080000:2.0:1787841981.572050:0:14354:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787841981.572482:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695116160 00000100:00100000:0.0:1787841981.572511:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695116160 00000100:00100000:0.0:1787841981.572570:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 4 00000100:00100000:0.0:1787841981.572581:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe9afa850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d176eb3a-a183-4a09-a413-a2a087378ac7+11:14438:x1874687695116160:12345-192.168.201.1@tcp:35:lfs.0 00000100:00100000:0.0:1787841981.576589:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe9afa850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d176eb3a-a183-4a09-a413-a2a087378ac7+12:14438:x1874687695116160:12345-192.168.201.1@tcp:35:lfs.0 Request processed in 3991us (4549us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1787841981.576605:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 4 00000100:00100000:3.0:1787841981.651476:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841981.651553:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695116288 00000100:00100000:1.0:1787841981.651570:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695116288 00000100:00100000:1.0:1787841981.651753:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 27 00000100:00100000:1.0:1787841981.651766:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e64780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d29cd7d6-5033-4a84-a074-c74886c050cd+10:14444:x1874687695116288:12345-192.168.201.1@tcp:101:bash.0 00010000:00010000:1.0:1787841981.651804:0:14323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841981.651829:0:14323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3330600/0xe3dac0c99afff7e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6ca4 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.651928:0:14323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3330400/0xe3dac0c99afff7ec lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.651945:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3330400/0xe3dac0c99afff7ec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.651958:0:14323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3330400/0xe3dac0c99afff7ec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.651977:0:14323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331000/0xe3dac0c99afff7f3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.651984:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331000/0xe3dac0c99afff7f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.651990:0:14323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331000/0xe3dac0c99afff7f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.652147:0:14323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331400/0xe3dac0c99afff7fa lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.652156:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331400/0xe3dac0c99afff7fa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.652163:0:14323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331400/0xe3dac0c99afff7fa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787841981.652204:0:14323:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:1.0:1787841981.652209:0:14323:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787841981.652265:0:14323:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331400/0xe3dac0c99afff7fa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.652280:0:14323:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3330400/0xe3dac0c99afff7ec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.652287:0:14323:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3330400/0xe3dac0c99afff7ec lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.652295:0:14323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3330400/0xe3dac0c99afff7ec lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.652301:0:14323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cac3330400 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:1.0:1787841981.652306:0:14323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3330400/0xe3dac0c99afff7ec lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.652314:0:14323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3330400/0xe3dac0c99afff7ec lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.652327:0:14323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92cbc57e3500) 00010000:00010000:1.0:1787841981.652336:0:14323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787841981.652341:0:14323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3330400/0xe3dac0c99afff7ec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.652348:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3330400/0xe3dac0c99afff7ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.652378:0:14323:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331000/0xe3dac0c99afff7f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.652384:0:14323:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331000/0xe3dac0c99afff7f3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.652390:0:14323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331000/0xe3dac0c99afff7f3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.652396:0:14323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cac3331000 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:1.0:1787841981.652398:0:14323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331000/0xe3dac0c99afff7f3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.652404:0:14323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331000/0xe3dac0c99afff7f3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.652410:0:14323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff92cbcd829100) 00010000:00010000:1.0:1787841981.652413:0:14323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787841981.652415:0:14323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331000/0xe3dac0c99afff7f3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.652421:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331000/0xe3dac0c99afff7f3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.652451:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3330600/0xe3dac0c99afff7e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6ca4 expref: 12 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.652475:0:14323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331400/0xe3dac0c99afff7fa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6ca4 expref: 11 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.652483:0:14323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff92cbc3b04400) 00010000:00010000:1.0:1787841981.652486:0:14323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787841981.652488:0:14323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cac3331400, rc 0) 00000100:00100000:1.0:1787841981.652562:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e64780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d29cd7d6-5033-4a84-a074-c74886c050cd+11:14444:x1874687695116288:12345-192.168.201.1@tcp:101:bash.0 Request processed in 799us (1100us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841981.652570:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 27 00000100:00100000:3.0:1787841981.655463:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841981.655584:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695116544 00000100:00100000:2.0:1787841981.655598:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695116544 00000100:00100000:2.0:1787841981.655927:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 28 00000100:00100000:2.0:1787841981.655937:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e66d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d29cd7d6-5033-4a84-a074-c74886c050cd+11:14444:x1874687695116544:12345-192.168.201.1@tcp:101:bash.0 00010000:00010000:2.0:1787841981.655971:0:14324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841981.655996:0:14324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104000/0xe3dac0c99afff801 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6cab expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.656137:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105c00/0xe3dac0c99afff808 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.656150:0:14324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104e00/0xe3dac0c99afff7de lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6c9d expref: 11 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.656158:0:14324:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105c00/0xe3dac0c99afff808 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.656198:0:14324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104e00/0xe3dac0c99afff7de lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6c9d expref: 11 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.656213:0:14324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104e00/0xe3dac0c99afff7de lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6c9d expref: 11 pid: 14324 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841981.656230:0:14324:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cc00ddfc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14324:1874687715031040:192.168.201.1@tcp:104: 00000100:00100000:2.0:1787841981.656336:0:14324:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc942b900 going to sleep for 11 seconds 00000100:00100000:3.0:1787841981.664426:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841981.664584:0:14324:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cc00ddfc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14324:1874687715031040:192.168.201.1@tcp:104: 00010000:00010000:2.0:1787841981.664626:0:14324:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105c00/0xe3dac0c99afff808 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841981.668270:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695116672 00000100:00100000:0.0:1787841981.668293:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695116672 00010000:00010000:0.0:1787841981.668369:0:14309:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104e00/0xe3dac0c99afff7de lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6c9d expref: 12 pid: 14324 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841981.668911:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 10 00000100:00100000:0.0:1787841981.668926:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e64b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d176eb3a-a183-4a09-a413-a2a087378ac7+12:2357:x1874687695116672:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787841981.668947:0:14309:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787841981.668957:0:14309:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104e00/0xe3dac0c99afff7de lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6c9d expref: 12 pid: 14324 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841981.668982:0:14309:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104e00/0xe3dac0c99afff7de lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6c9d expref: 12 pid: 14324 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841981.669012:0:14309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104e00/0xe3dac0c99afff7de lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6c9d expref: 12 pid: 14324 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841981.669033:0:14309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff92cbc3b04400) 00010000:00010000:0.0:1787841981.669040:0:14309:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105c00/0xe3dac0c99afff808 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841981.669051:0:14309:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105c00/0xe3dac0c99afff808 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841981.669079:0:14309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105c00/0xe3dac0c99afff808 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841981.669107:0:14309:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787841981.669276:0:14324:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105c00/0xe3dac0c99afff808 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.669288:0:14324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105c00/0xe3dac0c99afff808 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.669323:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104600/0xe3dac0c99afff80f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.669334:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104600/0xe3dac0c99afff80f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.669343:0:14324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104600/0xe3dac0c99afff80f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.670522:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105400/0xe3dac0c99afff816 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.670538:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105400/0xe3dac0c99afff816 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.670547:0:14324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105400/0xe3dac0c99afff816 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787841981.670562:0:14324:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787841981.670601:0:14324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105c00/0xe3dac0c99afff808 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.670609:0:14324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105c00/0xe3dac0c99afff808 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.670616:0:14324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105c00/0xe3dac0c99afff808 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.670632:0:14324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6105c00 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:2.0:1787841981.670638:0:14324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105c00/0xe3dac0c99afff808 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.670648:0:14324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105c00/0xe3dac0c99afff808 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.670663:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff92cbc3b04400) 00010000:00010000:2.0:1787841981.670667:0:14324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787841981.670671:0:14324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105c00/0xe3dac0c99afff808 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.670678:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105c00/0xe3dac0c99afff808 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787841981.670694:0:14324:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c2d539a3 reply state 000000003e86907d transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104600/0xe3dac0c99afff80f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841981.670765:0:14324:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787841981.670819:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104000/0xe3dac0c99afff801 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6cab expref: 14 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.670837:0:14324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105400/0xe3dac0c99afff816 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6cab expref: 13 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.670846:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff92cbc3b04500) 00010000:00010000:2.0:1787841981.670849:0:14324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1787841981.670851:0:14324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc6105400, rc 0) 00000100:00100000:0.0:1787841981.671102:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e64b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d176eb3a-a183-4a09-a413-a2a087378ac7+11:2357:x1874687695116672:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 2177us (6687us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841981.671116:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 10 00000100:00100000:2.0:1787841981.672954:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e66d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d29cd7d6-5033-4a84-a074-c74886c050cd+14:14444:x1874687695116544:12345-192.168.201.1@tcp:101:bash.0 Request processed in 17005us (17493us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1787841981.673146:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 28 00010000:00010000:1.0:1787841981.678389:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104600/0xe3dac0c99afff80f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.678412:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104600/0xe3dac0c99afff80f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.678421:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104600/0xe3dac0c99afff80f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.678429:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6104600 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:1.0:1787841981.678434:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104600/0xe3dac0c99afff80f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.678443:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104600/0xe3dac0c99afff80f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.678469:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff92cbc3b04b00) 00010000:00010000:1.0:1787841981.678472:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787841981.678478:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104600/0xe3dac0c99afff80f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.678510:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104600/0xe3dac0c99afff80f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841981.694672:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841981.695464:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695116800 00000100:00100000:1.0:1787841981.695482:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695116800 00000100:00100000:1.0:1787841981.695583:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 29 00000100:00100000:1.0:1787841981.695597:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e67c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d29cd7d6-5033-4a84-a074-c74886c050cd+13:14444:x1874687695116800:12345-192.168.201.1@tcp:101:bash.0 00010000:00010000:1.0:1787841981.695637:0:14323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841981.695803:0:14323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3330600/0xe3dac0c99afff824 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6cb2 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.695910:0:14323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331000/0xe3dac0c99afff82b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.695930:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331000/0xe3dac0c99afff82b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.695946:0:14323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331000/0xe3dac0c99afff82b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787841981.696002:0:14323:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1787841981.696008:0:14323:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787841981.696033:0:14323:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331000/0xe3dac0c99afff82b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.696045:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331000/0xe3dac0c99afff82b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.696073:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3330600/0xe3dac0c99afff824 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6cb2 expref: 15 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.696137:0:14323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331000/0xe3dac0c99afff82b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6cb2 expref: 14 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.698088:0:14323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff92cbc3b04500) 00010000:00010000:1.0:1787841981.698102:0:14323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787841981.698111:0:14323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cac3331000, rc 0) 00000100:00100000:1.0:1787841981.698222:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e67c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d29cd7d6-5033-4a84-a074-c74886c050cd+14:14444:x1874687695116800:12345-192.168.201.1@tcp:101:bash.0 Request processed in 2623us (3565us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841981.698233:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 29 00000100:00100000:1.0:1787841981.711049:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841981.716269:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695117056 00000100:00100000:3.0:1787841981.716293:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695117056 00000100:00100000:3.0:1787841981.716395:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 5 00000100:00100000:1.0:1787841981.716401:0:14325:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:3.0:1787841981.716407:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac26dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d29cd7d6-5033-4a84-a074-c74886c050cd+14:14444:x1874687695117056:12345-192.168.201.1@tcp:35:bash.0 00000100:00100000:1.0:1787841981.716413:0:14325:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000100:00100000:3.0:1787841981.717010:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac26dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d29cd7d6-5033-4a84-a074-c74886c050cd+15:14444:x1874687695117056:12345-192.168.201.1@tcp:35:bash.0 Request processed in 602us (5970us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1787841981.717020:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 5 00000001:00080000:1.0:1787841981.835123:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000001:00080000:1.0:1787841981.835147:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934600 is committed 00000100:00100000:1.0:1787841981.860189:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841981.860345:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695117312 00000100:00100000:2.0:1787841981.860365:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695117312 00000100:00100000:2.0:1787841981.860481:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 30 00000100:00100000:2.0:1787841981.860494:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac26de1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d29cd7d6-5033-4a84-a074-c74886c050cd+12:14454:x1874687695117312:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:2.0:1787841981.860538:0:14324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841981.860569:0:14324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105c00/0xe3dac0c99afff832 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6cb9 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787841981.861085:0:14324:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1787841981.861583:0:14324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105c00/0xe3dac0c99afff832 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6cb9 expref: 14 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.861605:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92cbc57e3500) 00010000:00010000:2.0:1787841981.861609:0:14324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787841981.861616:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105c00/0xe3dac0c99afff832 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6cb9 expref: 14 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.861634:0:14324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc6105c00, rc 0) 00000100:00100000:2.0:1787841981.861804:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac26de1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d29cd7d6-5033-4a84-a074-c74886c050cd+13:14454:x1874687695117312:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 1311us (1624us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1787841981.861816:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 30 00000100:00100000:2.0:1787841981.867791:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841981.867894:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695117568 00000100:00100000:3.0:1787841981.867903:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695117568 00000100:00100000:3.0:1787841981.867974:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 6 00000100:00100000:3.0:1787841981.867984:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cc00ddfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d29cd7d6-5033-4a84-a074-c74886c050cd+13:14454:x1874687695117568:12345-192.168.201.1@tcp:35:lfs.0 00000100:00100000:3.0:1787841981.868463:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cc00ddfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d29cd7d6-5033-4a84-a074-c74886c050cd+14:14454:x1874687695117568:12345-192.168.201.1@tcp:35:lfs.0 Request processed in 478us (680us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1787841981.868471:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 6 00000100:00100000:0.0:1787841981.922626:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841981.922791:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695117824 00000100:00100000:1.0:1787841981.922800:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695117824 00000100:00100000:1.0:1787841981.922865:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 31 00000100:00100000:1.0:1787841981.922894:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac1114000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d29cd7d6-5033-4a84-a074-c74886c050cd+14:14457:x1874687695117824:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:1.0:1787841981.922920:0:14323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841981.922942:0:14323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331600/0xe3dac0c99afff840 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6cc0 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.923056:0:14323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3330000/0xe3dac0c99afff847 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.923081:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3330000/0xe3dac0c99afff847 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.923107:0:14323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3330000/0xe3dac0c99afff847 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787841981.923120:0:14323:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787841981.923252:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331600/0xe3dac0c99afff840 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6cc0 expref: 17 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.923283:0:14323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3330000/0xe3dac0c99afff847 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6cc0 expref: 16 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.923291:0:14323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff92cbc3b04500) 00010000:00010000:1.0:1787841981.923294:0:14323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787841981.923297:0:14323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cac3330000, rc 0) 00000100:00100000:1.0:1787841981.923360:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac1114000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d29cd7d6-5033-4a84-a074-c74886c050cd+16:14457:x1874687695117824:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 477us (746us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1787841981.923368:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 31 00000100:00100000:1.0:1787841981.930918:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841981.931056:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695117952 00000100:00100000:2.0:1787841981.931073:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695117952 00000100:00100000:2.0:1787841981.931137:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 32 00000100:00100000:2.0:1787841981.931147:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac26dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d29cd7d6-5033-4a84-a074-c74886c050cd+16:14457:x1874687695117952:12345-192.168.201.1@tcp:54:lfs.0 00010000:00010000:2.0:1787841981.931235:0:14322:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105c00/0xe3dac0c99afff855 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.931253:0:14322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105c00/0xe3dac0c99afff855 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.931265:0:14322:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105c00/0xe3dac0c99afff855 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.931292:0:14322:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105c00/0xe3dac0c99afff855 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.931299:0:14322:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105c00/0xe3dac0c99afff855 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.931305:0:14322:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105c00/0xe3dac0c99afff855 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.931310:0:14322:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6105c00 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:2.0:1787841981.931314:0:14322:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105c00/0xe3dac0c99afff855 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.931322:0:14322:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105c00/0xe3dac0c99afff855 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.931333:0:14322:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff92cbc3b04500) 00010000:00010000:2.0:1787841981.931336:0:14322:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787841981.931341:0:14322:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105c00/0xe3dac0c99afff855 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841981.931348:0:14322:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105c00/0xe3dac0c99afff855 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841981.931444:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac26dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d29cd7d6-5033-4a84-a074-c74886c050cd+16:14457:x1874687695117952:12345-192.168.201.1@tcp:54:lfs.0 Request processed in 297us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841981.931451:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 32 00000100:00100000:3.0:1787841981.934216:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841981.934430:0:16555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695118208 00000100:00100000:1.0:1787841981.934440:0:16555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695118208 00000100:00100000:1.0:1787841981.934498:0:16555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 7 00000100:00100000:1.0:1787841981.934507:0:16555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e67840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d29cd7d6-5033-4a84-a074-c74886c050cd+16:14457:x1874687695118208:12345-192.168.201.1@tcp:35:lfs.0 00000100:00100000:1.0:1787841981.934793:0:16555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e67840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d29cd7d6-5033-4a84-a074-c74886c050cd+17:14457:x1874687695118208:12345-192.168.201.1@tcp:35:lfs.0 Request processed in 286us (589us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1787841981.934801:0:16555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 7 00000100:00100000:3.0:1787841981.937973:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841981.938232:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695118336 00000100:00100000:1.0:1787841981.938242:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695118336 00000100:00100000:1.0:1787841981.938319:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 0 00000100:00100000:1.0:1787841981.938329:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbd4a9fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d29cd7d6-5033-4a84-a074-c74886c050cd+17:2354:x1874687695118336:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787841981.938346:0:14307:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787841981.938372:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3330000/0xe3dac0c99afff847 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6cc0 expref: 17 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841981.938402:0:14307:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff92cbc3b04500) 00010000:00010000:1.0:1787841981.938407:0:14307:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787841981.938466:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbd4a9fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d29cd7d6-5033-4a84-a074-c74886c050cd+16:2354:x1874687695118336:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 138us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841981.938473:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 0 00010000:00010000:0.0:1787841982.083239:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787841982.348390:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841982.348548:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695118592 00000100:00100000:1.0:1787841982.348558:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695118592 00000100:00100000:1.0:1787841982.348650:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 33 00000100:00100000:1.0:1787841982.348669:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cc00ddc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d29cd7d6-5033-4a84-a074-c74886c050cd+16:14488:x1874687695118592:12345-192.168.201.1@tcp:101:cat.0 00010000:00010000:1.0:1787841982.348693:0:14324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841982.348747:0:14324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3330000/0xe3dac0c99afff85c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6cc7 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841982.348872:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331600/0xe3dac0c99afff863 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841982.348897:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331600/0xe3dac0c99afff863 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841982.348909:0:14324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331600/0xe3dac0c99afff863 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787841982.348920:0:14324:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787841982.349094:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3330000/0xe3dac0c99afff85c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6cc7 expref: 19 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841982.349126:0:14324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331600/0xe3dac0c99afff863 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6cc7 expref: 18 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841982.349135:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff92cbc3b04500) 00010000:00010000:1.0:1787841982.349139:0:14324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787841982.349142:0:14324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cac3331600, rc 0) 00000100:00100000:1.0:1787841982.349205:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cc00ddc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d29cd7d6-5033-4a84-a074-c74886c050cd+18:14488:x1874687695118592:12345-192.168.201.1@tcp:101:cat.0 Request processed in 538us (824us total) trans 8589934606 rc 0/0 00000100:00100000:1.0:1787841982.349214:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 33 00000100:00100000:2.0:1787841982.355484:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841982.355603:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695118720 00000100:00100000:0.0:1787841982.355614:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695118720 00000100:00100000:0.0:1787841982.355748:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 1 00000100:00100000:0.0:1787841982.355759:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cc00dded00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d29cd7d6-5033-4a84-a074-c74886c050cd+18:2356:x1874687695118720:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787841982.355776:0:14309:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787841982.355813:0:14309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331600/0xe3dac0c99afff863 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6cc7 expref: 18 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841982.355850:0:14309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff92cbc3b04500) 00010000:00010000:0.0:1787841982.355855:0:14309:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787841982.355921:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cc00dded00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d29cd7d6-5033-4a84-a074-c74886c050cd+17:2356:x1874687695118720:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 164us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841982.355928:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 1 00000100:00100000:3.0:1787841982.358673:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841982.358814:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695118976 00000100:00100000:2.0:1787841982.358833:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695118976 00000100:00100000:2.0:1787841982.358900:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 8 00000100:00100000:2.0:1787841982.358909:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbd4a9f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d29cd7d6-5033-4a84-a074-c74886c050cd+17:14488:x1874687695118976:12345-192.168.201.1@tcp:35:cat.0 00000100:00100000:2.0:1787841982.359246:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbd4a9f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d29cd7d6-5033-4a84-a074-c74886c050cd+18:14488:x1874687695118976:12345-192.168.201.1@tcp:35:cat.0 Request processed in 337us (595us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1787841982.359266:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 8 00000100:00100000:2.0:1787841982.512561:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841982.512977:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695119232 00000100:00100000:0.0:1787841982.512989:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695119232 00000100:00100000:0.0:1787841982.513068:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 34 00000100:00100000:0.0:1787841982.513077:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cc00dde940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d29cd7d6-5033-4a84-a074-c74886c050cd+18:14494:x1874687695119232:12345-192.168.201.1@tcp:101:dd.0 00010000:00010000:0.0:1787841982.513120:0:14323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841982.513141:0:14323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6724e00/0xe3dac0c99afff871 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6cce expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841982.513246:0:14323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725200/0xe3dac0c99afff878 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841982.513273:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725200/0xe3dac0c99afff878 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841982.513285:0:14323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725200/0xe3dac0c99afff878 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787841982.513297:0:14323:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787841982.513444:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6724e00/0xe3dac0c99afff871 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6cce expref: 21 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841982.513464:0:14323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725200/0xe3dac0c99afff878 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6cce expref: 20 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841982.513473:0:14323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff92cbc3b04500) 00010000:00010000:0.0:1787841982.513477:0:14323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787841982.513481:0:14323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc6725200, rc 0) 00000100:00100000:0.0:1787841982.513548:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cc00dde940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d29cd7d6-5033-4a84-a074-c74886c050cd+20:14494:x1874687695119232:12345-192.168.201.1@tcp:101:dd.0 Request processed in 472us (995us total) trans 8589934608 rc 0/0 00000100:00100000:0.0:1787841982.513556:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 34 00000100:00100000:2.0:1787841982.525772:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841982.526209:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695119488 00000100:00100000:1.0:1787841982.526220:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695119488 00000100:00100000:1.0:1787841982.526292:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 35 00000100:00100000:1.0:1787841982.526302:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cc00ddd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d29cd7d6-5033-4a84-a074-c74886c050cd+20:14494:x1874687695119488:12345-192.168.201.1@tcp:36:dd.0 00010000:00010000:1.0:1787841982.526363:0:14324:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1787841982.526391:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725200/0xe3dac0c99afff878 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6cce expref: 20 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841982.526413:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331000/0xe3dac0c99afff82b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6cb2 expref: 19 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841982.526435:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff92cbc3b04500) 00010000:00010000:1.0:1787841982.526440:0:14324:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787841982.526647:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3330000/0xe3dac0c99afff886 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841982.526679:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3330000/0xe3dac0c99afff886 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841982.526689:0:14324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3330000/0xe3dac0c99afff886 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787841982.526801:0:14324:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:1.0:1787841982.527505:0:14324:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004013caab reply state 00000000c36aecad transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3330000/0xe3dac0c99afff886 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841982.527517:0:14324:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787841982.527779:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cc00ddd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d29cd7d6-5033-4a84-a074-c74886c050cd+21:14494:x1874687695119488:12345-192.168.201.1@tcp:36:dd.0 Request processed in 1475us (2015us total) trans 8589934610 rc 0/0 00000100:00100000:1.0:1787841982.527787:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 35 00000020:00080000:1.0:1787841982.527792:0:14324:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787841982.535976:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3330000/0xe3dac0c99afff886 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841982.535996:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3330000/0xe3dac0c99afff886 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841982.536003:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3330000/0xe3dac0c99afff886 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841982.536010:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cac3330000 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:1.0:1787841982.536015:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3330000/0xe3dac0c99afff886 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841982.536024:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3330000/0xe3dac0c99afff886 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841982.536068:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff92cbc3b04500) 00010000:00010000:1.0:1787841982.536071:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787841982.536077:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3330000/0xe3dac0c99afff886 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841982.536083:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3330000/0xe3dac0c99afff886 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841982.749115:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841982.749344:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695119744 00000100:00100000:3.0:1787841982.749354:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695119744 00000100:00100000:3.0:1787841982.749414:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 9 00000100:00100000:3.0:1787841982.749423:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cc00ddc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d29cd7d6-5033-4a84-a074-c74886c050cd+20:14494:x1874687695119744:12345-192.168.201.1@tcp:35:dd.0 00000100:00100000:3.0:1787841982.750100:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cc00ddc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d29cd7d6-5033-4a84-a074-c74886c050cd+21:14494:x1874687695119744:12345-192.168.201.1@tcp:35:dd.0 Request processed in 674us (993us total) trans 8589934611 rc 0/0 00000100:00100000:3.0:1787841982.750109:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 9 00000100:00100000:3.0:1787841983.067637:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841983.067817:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695119872 00000100:00100000:2.0:1787841983.067828:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695119872 00000100:00100000:2.0:1787841983.067926:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 36 00000100:00100000:2.0:1787841983.067938:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbd4a9de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d29cd7d6-5033-4a84-a074-c74886c050cd+21:14508:x1874687695119872:12345-192.168.201.1@tcp:101:stat.0 00010000:00010000:2.0:1787841983.067962:0:14322:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:3.0:1787841983.067978:0:14318:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787841983.067984:0:14322:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105c00/0xe3dac0c99afff88d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6cd5 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841983.068066:0:14322:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104200/0xe3dac0c99afff894 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841983.068100:0:14322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104200/0xe3dac0c99afff894 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841983.068128:0:14322:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104200/0xe3dac0c99afff894 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841983.068147:0:14322:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104000/0xe3dac0c99afff89b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841983.068154:0:14322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104000/0xe3dac0c99afff89b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841983.068161:0:14322:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104000/0xe3dac0c99afff89b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841983.068575:0:14322:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104600/0xe3dac0c99afff8a2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841983.068586:0:14322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104600/0xe3dac0c99afff8a2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841983.068594:0:14322:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104600/0xe3dac0c99afff8a2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787841983.068633:0:14322:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787841983.068638:0:14322:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787841983.068678:0:14322:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104600/0xe3dac0c99afff8a2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841983.068692:0:14322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104600/0xe3dac0c99afff8a2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841983.068748:0:14322:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104200/0xe3dac0c99afff894 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841983.068754:0:14322:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104200/0xe3dac0c99afff894 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841983.068761:0:14322:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104200/0xe3dac0c99afff894 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841983.068767:0:14322:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6104200 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:2.0:1787841983.068771:0:14322:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104200/0xe3dac0c99afff894 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841983.068779:0:14322:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104200/0xe3dac0c99afff894 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841983.068792:0:14322:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff92cbc3b04400) 00010000:00010000:2.0:1787841983.068795:0:14322:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787841983.068800:0:14322:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104200/0xe3dac0c99afff894 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841983.068806:0:14322:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104200/0xe3dac0c99afff894 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841983.068818:0:14322:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104000/0xe3dac0c99afff89b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841983.068824:0:14322:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104000/0xe3dac0c99afff89b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841983.068829:0:14322:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104000/0xe3dac0c99afff89b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841983.068840:0:14322:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6104000 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:2.0:1787841983.068843:0:14322:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104000/0xe3dac0c99afff89b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841983.068848:0:14322:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104000/0xe3dac0c99afff89b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841983.068856:0:14322:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff92cbc3b04000) 00010000:00010000:2.0:1787841983.068858:0:14322:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787841983.068861:0:14322:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104000/0xe3dac0c99afff89b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841983.068878:0:14322:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104000/0xe3dac0c99afff89b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841983.068911:0:14322:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105c00/0xe3dac0c99afff88d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6cd5 expref: 23 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841983.068923:0:14322:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104600/0xe3dac0c99afff8a2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6cd5 expref: 22 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841983.068930:0:14322:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff92cbc3b04500) 00010000:00010000:2.0:1787841983.068932:0:14322:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787841983.068935:0:14322:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc6104600, rc 0) 00000100:00100000:2.0:1787841983.069013:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbd4a9de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d29cd7d6-5033-4a84-a074-c74886c050cd+22:14508:x1874687695119872:12345-192.168.201.1@tcp:101:stat.0 Request processed in 1078us (1387us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841983.069020:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 36 00010000:00010000:1.0:1787841983.106474:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787841983.160031:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841983.160885:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695120128 00000100:00100000:1.0:1787841983.160896:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695120128 00000100:00100000:1.0:1787841983.161020:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 37 00000100:00100000:1.0:1787841983.161031:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cc00dde580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d29cd7d6-5033-4a84-a074-c74886c050cd+22:14514:x1874687695120128:12345-192.168.201.1@tcp:36:truncate.0 00010000:00010000:1.0:1787841983.161130:0:14324:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787841983.161165:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104600/0xe3dac0c99afff8a2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6cd5 expref: 22 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841983.161187:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff92cbc3b04500) 00010000:00010000:1.0:1787841983.161194:0:14324:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787841983.161434:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3330000/0xe3dac0c99afff8a9 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841983.161450:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3330000/0xe3dac0c99afff8a9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841983.161459:0:14324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3330000/0xe3dac0c99afff8a9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787841983.161514:0:14324:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934612 00000004:00010000:1.0:1787841983.161551:0:14324:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c8e8fe41 reply state 000000002321fe09 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3330000/0xe3dac0c99afff8a9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841983.161560:0:14324:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787841983.161689:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cc00dde580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d29cd7d6-5033-4a84-a074-c74886c050cd+24:14514:x1874687695120128:12345-192.168.201.1@tcp:36:truncate.0 Request processed in 658us (1677us total) trans 8589934613 rc 0/0 00000100:00100000:1.0:1787841983.161751:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 37 00000020:00080000:1.0:1787841983.161757:0:14324:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787841983.166228:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3330000/0xe3dac0c99afff8a9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841983.166267:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3330000/0xe3dac0c99afff8a9 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841983.166275:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3330000/0xe3dac0c99afff8a9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841983.166282:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cac3330000 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:0.0:1787841983.166287:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3330000/0xe3dac0c99afff8a9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841983.166306:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3330000/0xe3dac0c99afff8a9 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841983.166327:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff92cbc3b04500) 00010000:00010000:0.0:1787841983.166330:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841983.166335:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3330000/0xe3dac0c99afff8a9 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841983.166341:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3330000/0xe3dac0c99afff8a9 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841983.232927:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787841983.232952:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac11170c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874687715031168:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787841983.233358:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841983.233680:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715031168 00000100:00100000:1.0:1787841983.233690:0:15008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715031168 00000100:00100000:1.0:1787841983.233813:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787841983.233824:0:15008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cc00ddf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874687715031168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787841983.233874:0:15008:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787841983.233944:0:15008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cc00ddf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874687715031168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841983.233952:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787841983.234167:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac11170c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874687715031168:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787841983.234759:0:14318:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787841983.453507:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841983.453638:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695120256 00000100:00100000:0.0:1787841983.453654:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695120256 00000100:00100000:0.0:1787841983.454034:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 38 00000100:00100000:0.0:1787841983.454058:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff3d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d29cd7d6-5033-4a84-a074-c74886c050cd+23:14528:x1874687695120256:12345-192.168.201.1@tcp:101:stat.0 00010000:00010000:0.0:1787841983.454088:0:14323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841983.454111:0:14323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6724e00/0xe3dac0c99afff8b0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6cdc expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841983.454176:0:14323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725a00/0xe3dac0c99afff8b7 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841983.454217:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725a00/0xe3dac0c99afff8b7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841983.454228:0:14323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725a00/0xe3dac0c99afff8b7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841983.454246:0:14323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725200/0xe3dac0c99afff8be lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841983.454253:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725200/0xe3dac0c99afff8be lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841983.454259:0:14323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725200/0xe3dac0c99afff8be lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841983.454629:0:14323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725000/0xe3dac0c99afff8c5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841983.454639:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725000/0xe3dac0c99afff8c5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841983.454646:0:14323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725000/0xe3dac0c99afff8c5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787841983.454679:0:14323:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:0.0:1787841983.454683:0:14323:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787841983.454735:0:14323:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725000/0xe3dac0c99afff8c5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841983.454755:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725000/0xe3dac0c99afff8c5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841983.454772:0:14323:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725a00/0xe3dac0c99afff8b7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841983.454779:0:14323:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725a00/0xe3dac0c99afff8b7 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841983.454785:0:14323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725a00/0xe3dac0c99afff8b7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841983.454790:0:14323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6725a00 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:0.0:1787841983.454794:0:14323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725a00/0xe3dac0c99afff8b7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841983.454802:0:14323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725a00/0xe3dac0c99afff8b7 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841983.454813:0:14323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff92cbc3b04400) 00010000:00010000:0.0:1787841983.454816:0:14323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841983.454820:0:14323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725a00/0xe3dac0c99afff8b7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841983.454826:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725a00/0xe3dac0c99afff8b7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841983.454836:0:14323:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725200/0xe3dac0c99afff8be lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841983.454842:0:14323:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725200/0xe3dac0c99afff8be lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841983.454848:0:14323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725200/0xe3dac0c99afff8be lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841983.454867:0:14323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6725200 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:0.0:1787841983.454870:0:14323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725200/0xe3dac0c99afff8be lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841983.454876:0:14323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725200/0xe3dac0c99afff8be lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841983.454884:0:14323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff92cbc57e3a00) 00010000:00010000:0.0:1787841983.454886:0:14323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841983.454888:0:14323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725200/0xe3dac0c99afff8be lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841983.454895:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725200/0xe3dac0c99afff8be lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841983.454929:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6724e00/0xe3dac0c99afff8b0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6cdc expref: 25 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841983.454944:0:14323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725000/0xe3dac0c99afff8c5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6cdc expref: 24 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841983.454951:0:14323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff92cbc3b04500) 00010000:00010000:0.0:1787841983.454953:0:14323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787841983.454955:0:14323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc6725000, rc 0) 00000100:00100000:0.0:1787841983.455033:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff3d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d29cd7d6-5033-4a84-a074-c74886c050cd+24:14528:x1874687695120256:12345-192.168.201.1@tcp:101:stat.0 Request processed in 989us (1544us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841983.455041:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 38 00000040:00080000:1.0:1787841983.618209:0:14354:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787841983.621301:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841983.621435:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695120512 00000100:00100000:1.0:1787841983.621510:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695120512 00000100:00100000:1.0:1787841983.621659:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 39 00000100:00100000:1.0:1787841983.621676:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbd4a9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d29cd7d6-5033-4a84-a074-c74886c050cd+24:14538:x1874687695120512:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:1.0:1787841983.621750:0:14324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841983.621780:0:14324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331000/0xe3dac0c99afff8cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6ce3 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787841983.622162:0:14324:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1787841983.622391:0:14324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331000/0xe3dac0c99afff8cc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6ce3 expref: 26 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841983.622427:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92cbc57e3500) 00010000:00010000:1.0:1787841983.622430:0:14324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787841983.622438:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331000/0xe3dac0c99afff8cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6ce3 expref: 26 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841983.622478:0:14324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cac3331000, rc 0) 00000100:00100000:1.0:1787841983.622592:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbd4a9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d29cd7d6-5033-4a84-a074-c74886c050cd+25:14538:x1874687695120512:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 922us (1307us total) trans 8589934614 rc 301/301 00000100:00100000:1.0:1787841983.622601:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 39 00000100:00100000:3.0:1787841983.630032:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841983.630252:0:16555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695120768 00000100:00100000:0.0:1787841983.630274:0:16555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695120768 00000100:00100000:0.0:1787841983.630398:0:16555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 10 00000100:00100000:0.0:1787841983.630412:0:16555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe9afb050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d29cd7d6-5033-4a84-a074-c74886c050cd+25:14538:x1874687695120768:12345-192.168.201.1@tcp:35:lfs.0 00000100:00100000:0.0:1787841983.630929:0:16555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe9afb050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d29cd7d6-5033-4a84-a074-c74886c050cd+26:14538:x1874687695120768:12345-192.168.201.1@tcp:35:lfs.0 Request processed in 518us (905us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1787841983.630937:0:16555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 10 00000100:00100000:3.0:1787841983.720175:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841983.722439:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695121024 00000100:00100000:0.0:1787841983.722455:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695121024 00000100:00100000:0.0:1787841983.722541:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 40 00000100:00100000:0.0:1787841983.722552:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbd4a9cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d29cd7d6-5033-4a84-a074-c74886c050cd+26:14544:x1874687695121024:12345-192.168.201.1@tcp:101:bash.0 00010000:00010000:0.0:1787841983.722579:0:14323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841983.722600:0:14323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6724e00/0xe3dac0c99afff8da lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6cea expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841983.722756:0:14323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725200/0xe3dac0c99afff8e1 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841983.722773:0:14323:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105400/0xe3dac0c99afff816 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6cab expref: 27 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841983.722782:0:14323:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725000/0xe3dac0c99afff8c5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6cdc expref: 27 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841983.722790:0:14323:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725200/0xe3dac0c99afff8e1 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841983.722831:0:14323:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725000/0xe3dac0c99afff8c5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6cdc expref: 27 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841983.722905:0:14323:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725000/0xe3dac0c99afff8c5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6cdc expref: 27 pid: 14323 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841983.722920:0:14323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac11161c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14323:1874687715031296:192.168.201.1@tcp:104: 00010000:00010000:0.0:1787841983.723040:0:14323:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105400/0xe3dac0c99afff816 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6cab expref: 27 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841983.723052:0:14323:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105400/0xe3dac0c99afff816 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6cab expref: 27 pid: 14324 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841983.723062:0:14323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac11143c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14323:1874687715031424:192.168.201.1@tcp:104: 00000100:00100000:0.0:1787841983.723087:0:14323:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbe771d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787841983.728468:0:14323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac11161c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14323:1874687715031296:192.168.201.1@tcp:104: 00000100:00100000:0.0:1787841983.728487:0:14323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac11143c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14323:1874687715031424:192.168.201.1@tcp:104: 00010000:00010000:0.0:1787841983.728517:0:14323:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725200/0xe3dac0c99afff8e1 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841983.731927:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841983.732036:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841983.732119:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695121152 00000100:00100000:2.0:1787841983.732131:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695121152 00010000:00010000:2.0:1787841983.732177:0:14307:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725000/0xe3dac0c99afff8c5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6cdc expref: 28 pid: 14323 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841983.732283:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695121280 00000100:00100000:2.0:1787841983.732287:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695121280 00010000:00010000:2.0:1787841983.732320:0:14307:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105400/0xe3dac0c99afff816 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6cab expref: 29 pid: 14324 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841983.732830:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 11 00000100:00100000:0.0:1787841983.732845:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf7331050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d29cd7d6-5033-4a84-a074-c74886c050cd+29:2356:x1874687695121152:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787841983.732909:0:14309:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787841983.732919:0:14309:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725000/0xe3dac0c99afff8c5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6cdc expref: 29 pid: 14323 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841983.732937:0:14309:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725000/0xe3dac0c99afff8c5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6cdc expref: 29 pid: 14323 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841983.732974:0:14309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725000/0xe3dac0c99afff8c5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6cdc expref: 29 pid: 14323 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841983.732991:0:14309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff92cbc3b04500) 00010000:00010000:0.0:1787841983.732995:0:14309:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725200/0xe3dac0c99afff8e1 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841983.733005:0:14309:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725200/0xe3dac0c99afff8e1 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841983.733012:0:14309:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787841983.733073:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf7331050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d29cd7d6-5033-4a84-a074-c74886c050cd+28:2356:x1874687695121152:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 231us (1155us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841983.733083:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 11 00000100:00100000:0.0:1787841983.733147:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 12 00000100:00100000:0.0:1787841983.733155:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbd4a9d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d29cd7d6-5033-4a84-a074-c74886c050cd+27:2356:x1874687695121280:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787841983.733163:0:14309:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787841983.733169:0:14309:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105400/0xe3dac0c99afff816 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6cab expref: 27 pid: 14324 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841983.733180:0:14309:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105400/0xe3dac0c99afff816 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6cab expref: 27 pid: 14324 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841983.733195:0:14309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105400/0xe3dac0c99afff816 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6cab expref: 27 pid: 14324 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841983.733217:0:14309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff92cbc3b04500) 00010000:00010000:0.0:1787841983.733221:0:14309:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725200/0xe3dac0c99afff8e1 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841983.733228:0:14309:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725200/0xe3dac0c99afff8e1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841983.733236:0:14309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725200/0xe3dac0c99afff8e1 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841983.733268:0:14309:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787841983.733293:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbd4a9d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d29cd7d6-5033-4a84-a074-c74886c050cd+26:2356:x1874687695121280:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 139us (1259us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841983.733409:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 12 00010000:00010000:3.0:1787841983.734058:0:14323:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725200/0xe3dac0c99afff8e1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841983.734082:0:14323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725200/0xe3dac0c99afff8e1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787841983.734102:0:14323:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:3.0:1787841983.734257:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6724e00/0xe3dac0c99afff8da lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6cea expref: 27 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841983.734275:0:14323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725200/0xe3dac0c99afff8e1 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6cea expref: 26 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841983.734283:0:14323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff92cbc3b04500) 00010000:00010000:3.0:1787841983.734286:0:14323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787841983.734289:0:14323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc6725200, rc 0) 00000100:00100000:3.0:1787841983.734338:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbd4a9cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d29cd7d6-5033-4a84-a074-c74886c050cd+26:14544:x1874687695121024:12345-192.168.201.1@tcp:101:bash.0 Request processed in 11788us (14174us total) trans 8589934616 rc 0/0 00000100:00100000:3.0:1787841983.734356:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 40 00000100:00100000:3.0:1787841983.742957:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841983.743206:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695121536 00000100:00100000:1.0:1787841983.743217:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695121536 00000100:00100000:1.0:1787841983.743282:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 41 00000100:00100000:1.0:1787841983.743293:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbd4a9cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d29cd7d6-5033-4a84-a074-c74886c050cd+26:14544:x1874687695121536:12345-192.168.201.1@tcp:36:bash.0 00010000:00010000:1.0:1787841983.743565:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331000/0xe3dac0c99afff8ef lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841983.743582:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331000/0xe3dac0c99afff8ef lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841983.743594:0:14324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331000/0xe3dac0c99afff8ef lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787841983.743661:0:14324:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000004:00010000:1.0:1787841983.743686:0:14324:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fd6258e8 reply state 00000000f76526f4 transno 8589934618 ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331000/0xe3dac0c99afff8ef lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841983.743695:0:14324:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787841983.743837:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbd4a9cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d29cd7d6-5033-4a84-a074-c74886c050cd+29:14544:x1874687695121536:12345-192.168.201.1@tcp:36:bash.0 Request processed in 546us (889us total) trans 8589934618 rc 0/0 00000100:00100000:1.0:1787841983.743846:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 41 00000020:00080000:1.0:1787841983.743850:0:14324:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787841983.746390:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331000/0xe3dac0c99afff8ef lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841983.746408:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331000/0xe3dac0c99afff8ef lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841983.746415:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331000/0xe3dac0c99afff8ef lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841983.746421:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cac3331000 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:0.0:1787841983.746426:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331000/0xe3dac0c99afff8ef lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841983.746434:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331000/0xe3dac0c99afff8ef lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841983.746469:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff92cbc3b04500) 00010000:00010000:0.0:1787841983.746472:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841983.746477:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331000/0xe3dac0c99afff8ef lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841983.746483:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331000/0xe3dac0c99afff8ef lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841983.747160:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841983.747782:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695121664 00000100:00100000:0.0:1787841983.747794:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695121664 00000100:00100000:0.0:1787841983.747848:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 42 00000100:00100000:0.0:1787841983.747871:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbd4a9e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d29cd7d6-5033-4a84-a074-c74886c050cd+28:14544:x1874687695121664:12345-192.168.201.1@tcp:101:bash.0 00010000:00010000:0.0:1787841983.747898:0:14323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841983.747917:0:14323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725000/0xe3dac0c99afff8f6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6cf1 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841983.747974:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725000/0xe3dac0c99afff8f6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6cf1 expref: 29 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841983.747989:0:14323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725000/0xe3dac0c99afff8f6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6cf1 expref: 29 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841983.748011:0:14323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff92cbc3b04500) 00010000:00010000:0.0:1787841983.748014:0:14323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787841983.748017:0:14323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc6725000, rc 0) 00000100:00100000:0.0:1787841983.748083:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbd4a9e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d29cd7d6-5033-4a84-a074-c74886c050cd+29:14544:x1874687695121664:12345-192.168.201.1@tcp:101:bash.0 Request processed in 214us (929us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841983.748091:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 42 00000100:00100000:3.0:1787841983.757028:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841983.757147:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695121792 00000100:00100000:2.0:1787841983.757157:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695121792 00000100:00100000:2.0:1787841983.757219:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 43 00000100:00100000:2.0:1787841983.757229:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbd4a9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d29cd7d6-5033-4a84-a074-c74886c050cd+29:14544:x1874687695121792:12345-192.168.201.1@tcp:101:bash.0 00010000:00010000:2.0:1787841983.757248:0:14322:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787841983.757268:0:14322:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105c00/0xe3dac0c99afff8fd lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6cf8 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841983.757377:0:14322:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104000/0xe3dac0c99afff904 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841983.757391:0:14322:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725200/0xe3dac0c99afff8e1 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6cea expref: 30 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841983.757409:0:14322:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104000/0xe3dac0c99afff904 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841983.757443:0:14322:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725200/0xe3dac0c99afff8e1 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6cea expref: 30 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841983.757457:0:14322:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725200/0xe3dac0c99afff8e1 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6cea expref: 30 pid: 14323 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841983.757470:0:14322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbff3d12c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14322:1874687715031552:192.168.201.1@tcp:104: 00000100:00100000:2.0:1787841983.757561:0:14322:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc942b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787841983.761240:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841983.761340:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695121920 00000100:00100000:0.0:1787841983.761349:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695121920 00010000:00010000:0.0:1787841983.761391:0:14309:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725200/0xe3dac0c99afff8e1 lrc: 5/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6cea expref: 31 pid: 14323 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841983.761438:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 13 00000100:00100000:0.0:1787841983.761448:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbd4a9fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d29cd7d6-5033-4a84-a074-c74886c050cd+31:2357:x1874687695121920:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787841983.761464:0:14309:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787841983.761470:0:14309:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725200/0xe3dac0c99afff8e1 lrc: 5/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6cea expref: 31 pid: 14323 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841983.761484:0:14309:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725200/0xe3dac0c99afff8e1 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6cea expref: 31 pid: 14323 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841983.761508:0:14309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff92cbc3b04500) 00010000:00010000:0.0:1787841983.761514:0:14309:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104000/0xe3dac0c99afff904 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841983.761523:0:14309:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104000/0xe3dac0c99afff904 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841983.761531:0:14309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104000/0xe3dac0c99afff904 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841983.761549:0:14309:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787841983.761621:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbd4a9fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d29cd7d6-5033-4a84-a074-c74886c050cd+31:2357:x1874687695121920:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 174us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841983.761629:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 13 00010000:00010000:2.0:1787841983.761762:0:14322:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725200/0xe3dac0c99afff8e1 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6cea expref: 30 pid: 14323 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841983.761779:0:14322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbff3d12c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14322:1874687715031552:192.168.201.1@tcp:104: 00010000:00010000:2.0:1787841983.761803:0:14322:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104000/0xe3dac0c99afff904 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841983.761811:0:14322:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104000/0xe3dac0c99afff904 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841983.761817:0:14322:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104000/0xe3dac0c99afff904 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787841983.761877:0:14322:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787841983.761882:0:14322:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787841983.761900:0:14322:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104000/0xe3dac0c99afff904 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841983.761969:0:14322:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105c00/0xe3dac0c99afff8fd lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6cf8 expref: 30 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841983.761985:0:14322:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104000/0xe3dac0c99afff904 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6cf8 expref: 29 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841983.761992:0:14322:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff92cbc3b04500) 00010000:00010000:2.0:1787841983.761994:0:14322:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787841983.761997:0:14322:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc6104000, rc 0) 00000100:00100000:2.0:1787841983.762023:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbd4a9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d29cd7d6-5033-4a84-a074-c74886c050cd+29:14544:x1874687695121792:12345-192.168.201.1@tcp:101:bash.0 Request processed in 4797us (5006us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841983.762030:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 43 00000100:00100000:3.0:1787841983.766688:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841983.767178:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695122176 00000100:00100000:1.0:1787841983.767189:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695122176 00000100:00100000:1.0:1787841983.767261:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 2 00000100:00100000:1.0:1787841983.767271:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbd4a9f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d29cd7d6-5033-4a84-a074-c74886c050cd+29:14544:x1874687695122176:12345-192.168.201.1@tcp:103:bash.0 00010000:00010000:1.0:1787841983.767286:0:14308:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1787841983.767312:0:14308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104000/0xe3dac0c99afff904 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6cf8 expref: 29 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841983.767334:0:14308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725000/0xe3dac0c99afff8f6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6cf1 expref: 28 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841983.767355:0:14308:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff92cbc3b04500) 00010000:00010000:1.0:1787841983.767366:0:14308:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787841983.767502:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbd4a9f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d29cd7d6-5033-4a84-a074-c74886c050cd+27:14544:x1874687695122176:12345-192.168.201.1@tcp:103:bash.0 Request processed in 233us (822us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841983.767509:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 2 00000100:00100000:1.0:1787841983.776591:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841983.777011:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695122304 00000100:00100000:3.0:1787841983.777021:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695122304 00000100:00100000:3.0:1787841983.777125:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 44 00000100:00100000:3.0:1787841983.777137:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac26dda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d29cd7d6-5033-4a84-a074-c74886c050cd+27:14544:x1874687695122304:12345-192.168.201.1@tcp:58:bash.0 00010000:00010000:3.0:1787841983.777255:0:14323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149ce00/0xe3dac0c99afff90b lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841983.777278:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149ce00/0xe3dac0c99afff90b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841983.777292:0:14323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149ce00/0xe3dac0c99afff90b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787841983.779014:0:14323:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787841983.779213:0:14323:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:3.0:1787841983.779297:0:14323:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1787841983.780297:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac26dda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d29cd7d6-5033-4a84-a074-c74886c050cd+27:14544:x1874687695122304:12345-192.168.201.1@tcp:58:bash.0 Request processed in 3156us (3710us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841983.780309:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 44 00000100:00100000:2.0:1787841983.783781:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841983.783849:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695122432 00000100:00100000:1.0:1787841983.783869:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695122432 00000100:00100000:1.0:1787841983.783930:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 45 00000100:00100000:1.0:1787841983.783949:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff3d12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d29cd7d6-5033-4a84-a074-c74886c050cd+27:14544:x1874687695122432:12345-192.168.201.1@tcp:101:bash.0 00010000:00010000:1.0:1787841983.783968:0:14322:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841983.783989:0:14322:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3330a00/0xe3dac0c99afff912 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6cff expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841983.784065:0:14322:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149ce00/0xe3dac0c99afff90b lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841983.784075:0:14322:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3330a00/0xe3dac0c99afff912 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6cff expref: 28 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841983.784094:0:14322:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149ce00/0xe3dac0c99afff90b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841983.784107:0:14322:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3330a00/0xe3dac0c99afff912 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6cff expref: 28 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841983.784122:0:14322:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff92cbc89cd200) 00010000:00010000:1.0:1787841983.784125:0:14322:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787841983.784129:0:14322:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3330a00/0xe3dac0c99afff912 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6cff expref: 28 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841983.784137:0:14322:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cac3330a00, rc 0) 00000100:00100000:1.0:1787841983.785436:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff3d12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d29cd7d6-5033-4a84-a074-c74886c050cd+28:14544:x1874687695122432:12345-192.168.201.1@tcp:101:bash.0 Request processed in 1489us (1670us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841983.785445:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 45 00010000:00010000:0.0:1787841984.134404:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787841984.641072:0:14354:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787841984.641082:0:14354:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787841984.641146:0:14354:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1787841984.644577:0:14354:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1787841984.644769:0:14354:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cac26dd2c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14354:1874687715031680:192.168.201.1@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787841984.644901:0:14354:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc8eda300 going to sleep for 11 seconds 00000100:00100000:3.0:1787841984.653440:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841984.653562:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695122560 00000100:00100000:2.0:1787841984.653571:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695122560 00000100:00100000:2.0:1787841984.653642:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 0 00000100:00100000:2.0:1787841984.653652:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbc9544780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:d29cd7d6-5033-4a84-a074-c74886c050cd+29:14545:x1874687695122560:12345-192.168.201.1@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1787841984.653767:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbc9544780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:d29cd7d6-5033-4a84-a074-c74886c050cd+29:14545:x1874687695122560:12345-192.168.201.1@tcp:900:lhsmtool_posix.0 Request processed in 116us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841984.653774:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 0 00000100:00100000:1.0:1787841984.656989:0:14354:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cac26dd2c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14354:1874687715031680:192.168.201.1@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787841984.657997:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841984.658036:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841984.658085:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841984.658120:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841984.658146:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841984.658167:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841984.658188:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841984.658214:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695122688 00000100:00100000:2.0:1787841984.658222:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695122688 00000100:00100000:2.0:1787841984.658269:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 123 00000100:00100000:2.0:1787841984.658279:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe7e2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34e5681c-63ea-4fb9-89c0-59dcf324dc9b+13:2355:x1874687695122688:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:3.0:1787841984.658564:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695122816 00000100:00100000:3.0:1787841984.658569:0:15006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695122816 00000100:00100000:3.0:1787841984.658602:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695123328 00000100:00100000:3.0:1787841984.658606:0:15006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695123328 00000100:00100000:3.0:1787841984.658632:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695122944 00000100:00100000:3.0:1787841984.658635:0:15006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695122944 00000100:00100000:3.0:1787841984.658646:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695123200 00000100:00100000:3.0:1787841984.658648:0:15006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695123200 00000100:00100000:3.0:1787841984.658662:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 19 00000100:00100000:3.0:1787841984.658669:0:15006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff3d21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d29cd7d6-5033-4a84-a074-c74886c050cd+5:2355:x1874687695122816:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:3.0:1787841984.658762:0:15006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff3d21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d29cd7d6-5033-4a84-a074-c74886c050cd+5:2355:x1874687695122816:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 92us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841984.658769:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 19 00000100:00100000:3.0:1787841984.658787:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 20 00000100:00100000:3.0:1787841984.658794:0:15006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff3d0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d176eb3a-a183-4a09-a413-a2a087378ac7+5:2355:x1874687695123328:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:3.0:1787841984.658818:0:15006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff3d0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d176eb3a-a183-4a09-a413-a2a087378ac7+5:2355:x1874687695123328:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 25us (733us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841984.658824:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 20 00000100:00100000:3.0:1787841984.658857:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 21 00000100:00100000:3.0:1787841984.658864:0:15006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff3d2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d29cd7d6-5033-4a84-a074-c74886c050cd+5:2355:x1874687695122944:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:3.0:1787841984.658887:0:15006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff3d2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d29cd7d6-5033-4a84-a074-c74886c050cd+5:2355:x1874687695122944:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 25us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841984.658893:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 21 00000100:00100000:3.0:1787841984.658905:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 22 00000100:00100000:3.0:1787841984.658910:0:15006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff3d3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d176eb3a-a183-4a09-a413-a2a087378ac7+5:2355:x1874687695123200:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:3.0:1787841984.658931:0:15006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff3d3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d176eb3a-a183-4a09-a413-a2a087378ac7+5:2355:x1874687695123200:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 21us (763us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841984.658936:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 22 00000100:00080000:3.0:1787841984.658952:0:14318:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787841984.658956:0:14318:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787841984.659066:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695123072 00000100:00100000:3.0:1787841984.659071:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695123072 00000100:00100000:3.0:1787841984.659102:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695123456 00000100:00100000:3.0:1787841984.659107:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695123456 00000100:00100000:3.0:1787841984.659120:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 31 00000100:00100000:3.0:1787841984.659126:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff3d2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d176eb3a-a183-4a09-a413-a2a087378ac7+6:2355:x1874687695123072:12345-192.168.201.1@tcp:400:kworker.0 00000100:00100000:3.0:1787841984.659162:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff3d2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d176eb3a-a183-4a09-a413-a2a087378ac7+6:2355:x1874687695123072:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 35us (1124us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841984.659167:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 31 00000100:00100000:3.0:1787841984.659179:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 46 00000100:00100000:3.0:1787841984.659186:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff3d0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d29cd7d6-5033-4a84-a074-c74886c050cd+28:14545:x1874687695123456:12345-192.168.201.1@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787841984.659205:0:14324:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787841984.659293:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff3d0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d29cd7d6-5033-4a84-a074-c74886c050cd+28:14545:x1874687695123456:12345-192.168.201.1@tcp:53:lhsmtool_posix.0 Request processed in 107us (1103us total) trans 0 rc 0/0 00000100:00080000:0.0:1787841984.659671:0:14318:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787841984.660575:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe7e2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34e5681c-63ea-4fb9-89c0-59dcf324dc9b+13:2355:x1874687695122688:12345-192.168.201.1@tcp:400:kworker.0 Request processed in 2294us (2450us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841984.660586:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 123 00000100:00100000:3.0:1787841984.664122:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 46 00000100:00100000:0.0:1787841984.672384:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841984.672543:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695123584 00000100:00100000:2.0:1787841984.672553:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695123584 00000100:00100000:2.0:1787841984.672612:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 47 00000100:00100000:2.0:1787841984.673774:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac11143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d29cd7d6-5033-4a84-a074-c74886c050cd+28:14545:x1874687695123584:12345-192.168.201.1@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787841984.673866:0:14323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104200/0xe3dac0c99afff919 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841984.673885:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104200/0xe3dac0c99afff919 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841984.673897:0:14323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104200/0xe3dac0c99afff919 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841984.673913:0:14323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104e00/0xe3dac0c99afff920 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841984.673920:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104e00/0xe3dac0c99afff920 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841984.673944:0:14323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104e00/0xe3dac0c99afff920 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841984.674388:0:14323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104400/0xe3dac0c99afff927 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841984.674399:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104400/0xe3dac0c99afff927 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841984.674407:0:14323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104400/0xe3dac0c99afff927 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787841984.674448:0:14323:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787841984.674453:0:14323:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787841984.674469:0:14323:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104400/0xe3dac0c99afff927 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841984.674479:0:14323:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104200/0xe3dac0c99afff919 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841984.674486:0:14323:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104200/0xe3dac0c99afff919 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841984.674492:0:14323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104200/0xe3dac0c99afff919 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841984.674499:0:14323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6104200 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:2.0:1787841984.674503:0:14323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104200/0xe3dac0c99afff919 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841984.674511:0:14323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104200/0xe3dac0c99afff919 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841984.674531:0:14323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff92cbc89cda00) 00010000:00010000:2.0:1787841984.674534:0:14323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787841984.674539:0:14323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104200/0xe3dac0c99afff919 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841984.674545:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104200/0xe3dac0c99afff919 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841984.674560:0:14323:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104e00/0xe3dac0c99afff920 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841984.674567:0:14323:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104e00/0xe3dac0c99afff920 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841984.674572:0:14323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104e00/0xe3dac0c99afff920 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841984.674578:0:14323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6104e00 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:2.0:1787841984.674580:0:14323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104e00/0xe3dac0c99afff920 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841984.674585:0:14323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104e00/0xe3dac0c99afff920 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841984.674591:0:14323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff92cbc3b04000) 00010000:00010000:2.0:1787841984.674593:0:14323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787841984.674596:0:14323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104e00/0xe3dac0c99afff920 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841984.674601:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104e00/0xe3dac0c99afff920 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841984.675208:0:14323:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104400/0xe3dac0c99afff927 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841984.675216:0:14323:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104400/0xe3dac0c99afff927 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841984.675221:0:14323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104400/0xe3dac0c99afff927 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841984.675227:0:14323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6104400 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:2.0:1787841984.675230:0:14323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104400/0xe3dac0c99afff927 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841984.675236:0:14323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104400/0xe3dac0c99afff927 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841984.675245:0:14323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff92cbc89cd200) 00010000:00010000:2.0:1787841984.675248:0:14323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787841984.675251:0:14323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104400/0xe3dac0c99afff927 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841984.675256:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104400/0xe3dac0c99afff927 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841984.675365:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac11143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d29cd7d6-5033-4a84-a074-c74886c050cd+28:14545:x1874687695123584:12345-192.168.201.1@tcp:34:lhsmtool_posix.0 Request processed in 2740us (2986us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841984.675375:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 47 00000100:00100000:0.0:1787841984.690353:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841984.699086:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695123840 00000100:00100000:3.0:1787841984.699107:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695123840 00000100:00100000:3.0:1787841984.700278:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 48 00000100:00100000:3.0:1787841984.700297:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac11161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d29cd7d6-5033-4a84-a074-c74886c050cd+28:14545:x1874687695123840:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787841984.700321:0:14324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841984.700343:0:14324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149cc00/0xe3dac0c99afff92e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6d06 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841984.700453:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99afff935 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841984.700469:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99afff935 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841984.700480:0:14324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99afff935 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787841984.700491:0:14324:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787841984.700583:0:14324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99afff935 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841984.700589:0:14324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99afff935 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841984.700594:0:14324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99afff935 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841984.700600:0:14324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc149c000 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:3.0:1787841984.700604:0:14324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99afff935 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841984.700625:0:14324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99afff935 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841984.700638:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff92cbc89cd200) 00010000:00010000:3.0:1787841984.700641:0:14324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787841984.700646:0:14324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99afff935 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841984.700652:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99afff935 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841984.700738:0:14324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149cc00/0xe3dac0c99afff92e lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6d06 expref: 30 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841984.700751:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff92cbc89cda00) 00010000:00010000:3.0:1787841984.700753:0:14324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787841984.700757:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149cc00/0xe3dac0c99afff92e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6d06 expref: 30 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841984.700767:0:14324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc149cc00, rc 0) 00000100:00100000:3.0:1787841984.700854:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac11161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d29cd7d6-5033-4a84-a074-c74886c050cd+29:14545:x1874687695123840:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 Request processed in 564us (10554us total) trans 8589934619 rc 301/301 00000100:00100000:3.0:1787841984.700861:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 48 00000100:00100000:3.0:1787841984.706743:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841984.708259:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695123968 00000100:00100000:2.0:1787841984.708274:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695123968 00000100:00100000:2.0:1787841984.708346:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 49 00000100:00100000:2.0:1787841984.708370:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbc9546580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d29cd7d6-5033-4a84-a074-c74886c050cd+29:14545:x1874687695123968:12345-192.168.201.1@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787841984.708425:0:14323:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787841984.708537:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbc9546580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d29cd7d6-5033-4a84-a074-c74886c050cd+29:14545:x1874687695123968:12345-192.168.201.1@tcp:53:lhsmtool_posix.0 Request processed in 169us (1803us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841984.708542:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 49 00000100:00100000:0.0:1787841984.718763:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841984.718905:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695124224 00000100:00100000:3.0:1787841984.718979:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695124224 00000100:00100000:3.0:1787841984.719103:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 50 00000100:00100000:3.0:1787841984.719117:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac1116d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d29cd7d6-5033-4a84-a074-c74886c050cd+29:14545:x1874687695124224:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787841984.719163:0:14324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841984.719187:0:14324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149cc00/0xe3dac0c99afff943 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6d0d expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787841984.720422:0:14324:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x6:0x0], count =28 00000004:00080000:3.0:1787841984.720432:0:14324:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x6:0x0]+28 in llog 00000004:00080000:3.0:1787841984.720481:0:14324:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:3.0:1787841984.720987:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99afff94a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841984.721005:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99afff94a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841984.721019:0:14324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99afff94a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841984.721082:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149cc00/0xe3dac0c99afff943 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6d0d expref: 32 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841984.721101:0:14324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99afff94a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6d0d expref: 31 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841984.721109:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff92cbc89cd100) 00010000:00010000:3.0:1787841984.721111:0:14324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787841984.721115:0:14324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc149c000, rc 0) 00000100:00100000:3.0:1787841984.721533:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac1116d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d29cd7d6-5033-4a84-a074-c74886c050cd+31:14545:x1874687695124224:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 Request processed in 2418us (2778us total) trans 8589934620 rc 0/0 00000100:00100000:3.0:1787841984.721542:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 50 00000100:00100000:0.0:1787841984.730601:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841984.731509:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695124480 00000100:00100000:1.0:1787841984.731520:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695124480 00000100:00100000:1.0:1787841984.731740:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 51 00000100:00100000:1.0:1787841984.731752:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac11152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d29cd7d6-5033-4a84-a074-c74886c050cd+31:14545:x1874687695124480:12345-192.168.201.1@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787841984.731815:0:14322:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787841984.731855:0:14322:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c000/0xe3dac0c99afff94a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6d0d expref: 31 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841984.731884:0:14322:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff92cbc89cd100) 00010000:00010000:1.0:1787841984.731896:0:14322:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787841984.731930:0:14322:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331200/0xe3dac0c99afff958 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841984.731945:0:14322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331200/0xe3dac0c99afff958 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841984.731955:0:14322:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331200/0xe3dac0c99afff958 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841984.731968:0:14322:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331000/0xe3dac0c99afff95f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x61519d99 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841984.731974:0:14322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331000/0xe3dac0c99afff95f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x61519d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841984.731980:0:14322:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331000/0xe3dac0c99afff95f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x61519d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841984.732246:0:14322:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331200/0xe3dac0c99afff958 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841984.732260:0:14322:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331200/0xe3dac0c99afff958 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841984.732267:0:14322:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331200/0xe3dac0c99afff958 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841984.732275:0:14322:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cac3331200 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:1.0:1787841984.732279:0:14322:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331200/0xe3dac0c99afff958 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841984.732287:0:14322:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331200/0xe3dac0c99afff958 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841984.732295:0:14322:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff92cbc3b04400) 00010000:00010000:1.0:1787841984.732298:0:14322:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787841984.732303:0:14322:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331200/0xe3dac0c99afff958 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841984.732308:0:14322:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331200/0xe3dac0c99afff958 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841984.732330:0:14322:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331000/0xe3dac0c99afff95f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x61519d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841984.732336:0:14322:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331000/0xe3dac0c99afff95f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x61519d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841984.732341:0:14322:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331000/0xe3dac0c99afff95f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x61519d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841984.732345:0:14322:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cac3331000 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:1.0:1787841984.732355:0:14322:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331000/0xe3dac0c99afff95f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x61519d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841984.732361:0:14322:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331000/0xe3dac0c99afff95f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x61519d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841984.732369:0:14322:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x61519d99 (ffff92cbcd829100) 00010000:00010000:1.0:1787841984.732371:0:14322:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787841984.732374:0:14322:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331000/0xe3dac0c99afff95f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x61519d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841984.732379:0:14322:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331000/0xe3dac0c99afff95f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x61519d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841984.732463:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac11152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d29cd7d6-5033-4a84-a074-c74886c050cd+30:14545:x1874687695124480:12345-192.168.201.1@tcp:36:lhsmtool_posix.0 Request processed in 713us (1884us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787841984.732470:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 51 00000100:00100000:0.0:1787841984.739671:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841984.739780:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695124608 00000100:00100000:3.0:1787841984.739801:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695124608 00000100:00100000:3.0:1787841984.739859:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 52 00000100:00100000:3.0:1787841984.739869:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac1117480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d29cd7d6-5033-4a84-a074-c74886c050cd+30:14545:x1874687695124608:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787841984.739892:0:14324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841984.739980:0:14324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149cc00/0xe3dac0c99afff966 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6d14 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841984.740021:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c200/0xe3dac0c99afff96d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841984.740033:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c200/0xe3dac0c99afff96d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841984.740052:0:14324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c200/0xe3dac0c99afff96d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841984.740150:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149cc00/0xe3dac0c99afff966 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6d14 expref: 32 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841984.740275:0:14324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149c200/0xe3dac0c99afff96d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6d14 expref: 31 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841984.740283:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff92cbc89cd800) 00010000:00010000:3.0:1787841984.740287:0:14324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787841984.740290:0:14324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc149c200, rc 0) 00000100:00100000:0.0:1787841984.740567:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac1117480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d29cd7d6-5033-4a84-a074-c74886c050cd+31:14545:x1874687695124608:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 Request processed in 697us (901us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841984.740574:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 52 00000100:00100000:3.0:1787841984.744510:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841984.745140:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695124864 00000100:00100000:1.0:1787841984.745234:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695124864 00000100:00100000:1.0:1787841984.745352:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 53 00000100:00100000:1.0:1787841984.745362:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbc9545680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d29cd7d6-5033-4a84-a074-c74886c050cd+31:14545:x1874687695124864:12345-192.168.201.1@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787841984.745451:0:14322:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331000/0xe3dac0c99afff974 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841984.745470:0:14322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331000/0xe3dac0c99afff974 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841984.745483:0:14322:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331000/0xe3dac0c99afff974 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787841984.746059:0:14322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:1.0:1787841984.746088:0:14322:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 524744389567ns, next at 525744386325ns, rc = 0 00000004:00010000:1.0:1787841984.746992:0:14322:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000057ceb479 reply state 000000003ef851f6 transno 8589934621 ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331000/0xe3dac0c99afff974 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841984.747008:0:14322:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787841984.747131:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbc9545680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d29cd7d6-5033-4a84-a074-c74886c050cd+33:14545:x1874687695124864:12345-192.168.201.1@tcp:36:lhsmtool_posix.0 Request processed in 1768us (2629us total) trans 8589934621 rc 0/0 00000100:00100000:1.0:1787841984.747140:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 53 00010000:00010000:1.0:1787841984.749404:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331000/0xe3dac0c99afff974 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841984.749422:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331000/0xe3dac0c99afff974 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841984.749429:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331000/0xe3dac0c99afff974 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841984.749435:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cac3331000 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:1.0:1787841984.749440:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331000/0xe3dac0c99afff974 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841984.749448:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331000/0xe3dac0c99afff974 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841984.749464:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff92cbc89cd800) 00010000:00010000:1.0:1787841984.749468:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787841984.749472:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331000/0xe3dac0c99afff974 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841984.749479:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3331000/0xe3dac0c99afff974 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14322 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841984.751435:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841984.751528:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695124992 00000100:00100000:0.0:1787841984.751538:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695124992 00000100:00100000:0.0:1787841984.751598:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 54 00000100:00100000:0.0:1787841984.751609:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff3d1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d29cd7d6-5033-4a84-a074-c74886c050cd+32:14545:x1874687695124992:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787841984.751639:0:14324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841984.751658:0:14324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725a00/0xe3dac0c99afff97b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6d1b expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841984.751846:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725a00/0xe3dac0c99afff97b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6d1b expref: 33 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841984.751861:0:14324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725a00/0xe3dac0c99afff97b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6d1b expref: 33 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841984.751881:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff92cbc89cd800) 00010000:00010000:0.0:1787841984.751884:0:14324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787841984.751887:0:14324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc6725a00, rc 0) 00000100:00100000:0.0:1787841984.751959:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff3d1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d29cd7d6-5033-4a84-a074-c74886c050cd+33:14545:x1874687695124992:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 Request processed in 352us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841984.751984:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 54 00000100:00100000:0.0:1787841984.755817:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841984.755928:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695125120 00000100:00100000:3.0:1787841984.755940:0:15006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695125120 00000100:00100000:3.0:1787841984.756000:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 13 00000100:00100000:3.0:1787841984.756011:0:15006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac1114b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d29cd7d6-5033-4a84-a074-c74886c050cd+5:2357:x1874687695125120:12345-192.168.201.1@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1787841984.759424:0:15006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac1114b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d29cd7d6-5033-4a84-a074-c74886c050cd+6:2357:x1874687695125120:12345-192.168.201.1@tcp:2:lhsmtool_posix.0 Request processed in 3405us (3608us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1787841984.759438:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 13 00000100:00100000:3.0:1787841984.764446:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841984.764553:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695125376 00000100:00100000:1.0:1787841984.764563:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695125376 00000100:00100000:1.0:1787841984.764613:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 11 00000100:00100000:1.0:1787841984.764630:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbc9545a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d29cd7d6-5033-4a84-a074-c74886c050cd+33:14545:x1874687695125376:12345-192.168.201.1@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787841984.764903:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbc9545a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d29cd7d6-5033-4a84-a074-c74886c050cd+34:14545:x1874687695125376:12345-192.168.201.1@tcp:35:lhsmtool_posix.0 Request processed in 272us (467us total) trans 8589934622 rc 0/0 00000100:00100000:1.0:1787841984.764919:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 11 00000100:00100000:0.0:1787841984.768357:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841984.768542:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695125632 00000100:00100000:1.0:1787841984.768552:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695125632 00000100:00100000:1.0:1787841984.768780:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 55 00000100:00100000:1.0:1787841984.768793:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac1116940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d29cd7d6-5033-4a84-a074-c74886c050cd+34:14545:x1874687695125632:12345-192.168.201.1@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787841984.768933:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac1116940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d29cd7d6-5033-4a84-a074-c74886c050cd+34:14545:x1874687695125632:12345-192.168.201.1@tcp:57:lhsmtool_posix.0 Request processed in 144us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841984.771130:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 55 00000100:00100000:0.0:1787841984.773174:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841984.773309:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695125760 00000100:00100000:3.0:1787841984.773322:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695125760 00000100:00100000:3.0:1787841984.773388:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 56 00000100:00100000:3.0:1787841984.773398:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac1115680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d29cd7d6-5033-4a84-a074-c74886c050cd+34:14545:x1874687695125760:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787841984.773421:0:14324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841984.773443:0:14324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d800/0xe3dac0c99afff982 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6d22 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841984.773517:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99afff989 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841984.773531:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99afff989 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841984.773542:0:14324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99afff989 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787841984.773576:0:14324:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787841984.773592:0:14324:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99afff989 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841984.773629:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d800/0xe3dac0c99afff982 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6d22 expref: 36 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841984.773646:0:14324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99afff989 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6d22 expref: 35 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841984.773655:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff92cbc89cd800) 00010000:00010000:3.0:1787841984.773670:0:14324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787841984.773674:0:14324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cc00d9de00, rc 0) 00000100:00100000:3.0:1787841984.773772:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac1115680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d29cd7d6-5033-4a84-a074-c74886c050cd+35:14545:x1874687695125760:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 Request processed in 375us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841984.773781:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 56 00000100:00100000:3.0:1787841984.781095:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841984.781221:0:16199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695125888 00000100:00100000:0.0:1787841984.781231:0:16199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695125888 00000100:00100000:0.0:1787841984.781303:0:16199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 14 00000100:00100000:0.0:1787841984.781314:0:16199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbc9544f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d29cd7d6-5033-4a84-a074-c74886c050cd+6:2356:x1874687695125888:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787841984.781336:0:16199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787841984.781362:0:16199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000642bb64c/0xe3dac0c99afff990 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6d29 expref: -99 pid: 16199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787841984.781390:0:16199:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a904dc1, blocks: 0x1 00010000:00010000:0.0:1787841984.781411:0:16199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=524s v=(0 0) 00010000:00010000:0.0:1787841984.781416:0:16199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787841984.781427:0:16199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000642bb64c/0xe3dac0c99afff990 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6d29 expref: 7 pid: 16199 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841984.781446:0:16199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000642bb64c/0xe3dac0c99afff990 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6d29 expref: 7 pid: 16199 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841984.781459:0:16199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cbc6724e00, rc 0) 00000100:00100000:0.0:1787841984.781537:0:16199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbc9544f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d29cd7d6-5033-4a84-a074-c74886c050cd+7:2356:x1874687695125888:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 Request processed in 225us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841984.781545:0:16199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 14 00000100:00100000:0.0:1787841984.794849:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841984.794958:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695126144 00000100:00100000:2.0:1787841984.794968:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695126144 00000100:00100000:2.0:1787841984.795039:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 57 00000100:00100000:2.0:1787841984.795049:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac1117c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d29cd7d6-5033-4a84-a074-c74886c050cd+35:14545:x1874687695126144:12345-192.168.201.1@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787841984.795163:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac1117c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d29cd7d6-5033-4a84-a074-c74886c050cd+35:14545:x1874687695126144:12345-192.168.201.1@tcp:57:lhsmtool_posix.0 Request processed in 116us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841984.795171:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 57 00000100:00100000:2.0:1787841984.802562:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841984.802668:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695126272 00000100:00100000:0.0:1787841984.802677:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695126272 00000100:00100000:0.0:1787841984.802786:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 58 00000100:00100000:0.0:1787841984.802795:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbc3dcf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d29cd7d6-5033-4a84-a074-c74886c050cd+35:14545:x1874687695126272:12345-192.168.201.1@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1787841984.873173:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934615 is committed 00000001:00080000:3.0:1787841984.873206:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000004:00080000:3.0:1787841984.873214:0:5860:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:1.0:1787841984.873693:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787841984.873737:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbc9545e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874687715031808:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787841984.873805:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841984.875578:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbc3dcf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d29cd7d6-5033-4a84-a074-c74886c050cd+19:14545:x1874687695126272:12345-192.168.201.1@tcp:44:lhsmtool_posix.0 Request processed in 72773us (73018us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841984.875593:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 58 00000100:00100000:0.0:1787841984.875865:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715031808 00000100:00100000:0.0:1787841984.875875:0:15007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715031808 00000100:00100000:0.0:1787841984.875955:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787841984.875964:0:15007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac26dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1874687715031808:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1787841984.876140:0:15007:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1787841984.876144:0:15007:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1787841984.876147:0:15007:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787841984.876149:0:15007:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787841985 -> 1787841985 00002000:00010000:0.0:1787841984.876151:0:15007:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1787841984.876223:0:15007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac26dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3300:x1874687715031808:12345-0@lo:2:osp-syn-1-0.0 Request processed in 259us (2416us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1787841984.876230:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:0.0:1787841984.876280:0:3300:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff92cbc9545e00/2, rc 0, transno 8589934595 00000100:00100000:0.0:1787841984.876286:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbc9545e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1874687715031808:0@lo:2:osp-syn-1-0.0 00000100:00080000:1.0:1787841984.877758:0:14318:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787841984.881492:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841984.884108:0:16199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695126400 00000100:00100000:1.0:1787841984.884124:0:16199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695126400 00000100:00100000:0.0:1787841984.884593:0:16199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 16 00000100:00100000:0.0:1787841984.884604:0:16199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac1115e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d29cd7d6-5033-4a84-a074-c74886c050cd+7:2356:x1874687695126400:12345-192.168.201.1@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1787841984.885601:0:16199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac1115e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d29cd7d6-5033-4a84-a074-c74886c050cd+7:2356:x1874687695126400:12345-192.168.201.1@tcp:16:lhsmtool_posix.0 Request processed in 994us (4114us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841984.885619:0:16199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 16 00000100:00100000:2.0:1787841984.891011:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841984.892653:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695126656 00000100:00100000:3.0:1787841984.892667:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695126656 00000100:00100000:3.0:1787841984.893547:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 59 00000100:00100000:3.0:1787841984.893562:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbc3dccb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d29cd7d6-5033-4a84-a074-c74886c050cd+13:14545:x1874687695126656:12345-192.168.201.1@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787841984.893620:0:14324:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787841984.893646:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99afff989 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6d22 expref: 13 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841984.893666:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff92cbc89cd800) 00010000:00010000:3.0:1787841984.893670:0:14324:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787841984.893765:0:14324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d800/0xe3dac0c99afff997 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841984.893779:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d800/0xe3dac0c99afff997 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841984.893788:0:14324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d800/0xe3dac0c99afff997 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787841984.894517:0:14324:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000af1b5a7a reply state 000000004b9be7e8 transno 8589934623 ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d800/0xe3dac0c99afff997 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841984.894528:0:14324:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787841984.894632:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbc3dccb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d29cd7d6-5033-4a84-a074-c74886c050cd+14:14545:x1874687695126656:12345-192.168.201.1@tcp:36:lhsmtool_posix.0 Request processed in 1074us (3630us total) trans 8589934623 rc 0/0 00000100:00100000:3.0:1787841984.894639:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 59 00000100:00100000:2.0:1787841984.900649:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841984.900903:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695126784 00000100:00100000:1.0:1787841984.900921:0:15007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695126784 00000100:00100000:1.0:1787841984.900986:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 17 00000100:00100000:1.0:1787841984.900996:0:15007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbc3dce580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d29cd7d6-5033-4a84-a074-c74886c050cd+7:14545:x1874687695126784:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787841984.901014:0:15007:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787841984.901044:0:15007:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b36cf69/0xe3dac0c99afff99e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6d30 expref: -99 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841984.901076:0:15007:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000642bb64c/0xe3dac0c99afff990 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6d29 expref: 8 pid: 16199 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841984.901085:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787841984.901089:0:15007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787841984.901094:0:15007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b36cf69/0xe3dac0c99afff99e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6d30 expref: 8 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841984.901127:0:15007:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000642bb64c/0xe3dac0c99afff990 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6d29 expref: 8 pid: 16199 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841984.901140:0:15007:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000642bb64c/0xe3dac0c99afff990 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6d29 expref: 8 pid: 16199 timeout: 624 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841984.901156:0:15007:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e2f840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:15007:1874687715031936:192.168.201.1@tcp:104: 00000100:00100000:1.0:1787841984.901247:0:15007:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc8eda6c0 going to sleep for 11 seconds 00010000:00010000:0.0:1787841984.903335:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d800/0xe3dac0c99afff997 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841984.903365:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d800/0xe3dac0c99afff997 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841984.903373:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d800/0xe3dac0c99afff997 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841984.903378:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cc00d9d800 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:0.0:1787841984.903383:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d800/0xe3dac0c99afff997 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841984.903390:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d800/0xe3dac0c99afff997 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841984.903409:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff92cbc89cd800) 00010000:00010000:0.0:1787841984.903413:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787841984.903417:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d800/0xe3dac0c99afff997 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841984.903423:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d800/0xe3dac0c99afff997 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14324 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841984.906184:0:15007:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e2f840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:15007:1874687715031936:192.168.201.1@tcp:104: 00010000:00010000:2.0:1787841984.906223:0:15007:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006b36cf69/0xe3dac0c99afff99e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6d30 expref: 8 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841984.906245:0:15007:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cac3331000, rc 0) 00000100:00100000:2.0:1787841984.906304:0:15007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbc3dce580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d29cd7d6-5033-4a84-a074-c74886c050cd+8:14545:x1874687695126784:12345-192.168.201.1@tcp:101:lhsmtool_posix.0 Request processed in 5310us (5665us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841984.906328:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 17 00000100:00100000:3.0:1787841984.908663:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841984.908902:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695126912 00000100:00100000:1.0:1787841984.908912:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695126912 00010000:00010000:1.0:1787841984.908954:0:14307:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000642bb64c/0xe3dac0c99afff990 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6d29 expref: 8 pid: 16199 timeout: 624 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841984.909024:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 14 00000100:00100000:1.0:1787841984.909035:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbc9547840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d29cd7d6-5033-4a84-a074-c74886c050cd+8:2356:x1874687695126912:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787841984.909067:0:14307:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787841984.909090:0:14307:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000642bb64c/0xe3dac0c99afff990 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6d29 expref: 8 pid: 16199 timeout: 624 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841984.909103:0:14307:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000642bb64c/0xe3dac0c99afff990 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6d29 expref: 8 pid: 16199 timeout: 624 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841984.909127:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000642bb64c/0xe3dac0c99afff990 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6d29 expref: 8 pid: 16199 timeout: 624 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841984.909159:0:14307:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787841984.909164:0:14307:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787841984.909171:0:14307:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006b36cf69/0xe3dac0c99afff99e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6d30 expref: 7 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841984.909183:0:14307:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b36cf69/0xe3dac0c99afff99e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6d30 expref: 7 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841984.909222:0:14307:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006b36cf69/0xe3dac0c99afff99e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6d30 expref: 7 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841984.909238:0:14307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e2f840 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:14307:1874687715032064:192.168.201.1@tcp:105: 00000100:00100000:1.0:1787841984.909321:0:14307:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc8eda6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787841984.919019:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841984.919128:0:14307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e2f840 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:14307:1874687715032064:192.168.201.1@tcp:105: 00010000:00010000:1.0:1787841984.919161:0:14307:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787841984.919235:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbc9547840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d29cd7d6-5033-4a84-a074-c74886c050cd+7:2356:x1874687695126912:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 10202us (10580us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841984.919245:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 14 00000100:00100000:3.0:1787841984.919760:0:15005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695127040 00000100:00100000:3.0:1787841984.919769:0:15005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695127040 00000100:00100000:3.0:1787841984.919821:0:15005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 18 00000100:00100000:3.0:1787841984.919830:0:15005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac1114f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d29cd7d6-5033-4a84-a074-c74886c050cd+7:2356:x1874687695127040:12345-192.168.201.1@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787841984.920036:0:15005:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1787841984.920040:0:15005:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1787841984 00002000:00010000:3.0:1787841984.920042:0:15005:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1787841982 00002000:00010000:3.0:1787841984.920044:0:15005:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787841985 -> 1787841984 00002000:00010000:3.0:1787841984.920047:0:15005:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1787841984.920094:0:15005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac1114f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d29cd7d6-5033-4a84-a074-c74886c050cd+8:2356:x1874687695127040:12345-192.168.201.1@tcp:2:lhsmtool_posix.0 Request processed in 264us (1084us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1787841984.920101:0:15005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 18 00000100:00100000:0.0:1787841984.929206:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841984.929322:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695127168 00000100:00100000:2.0:1787841984.929333:0:15006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695127168 00000100:00100000:2.0:1787841984.929390:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 19 00000100:00100000:2.0:1787841984.929402:0:15006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cac11170c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d29cd7d6-5033-4a84-a074-c74886c050cd+8:2357:x1874687695127168:12345-192.168.201.1@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787841984.929449:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000044d0f2cc/0xe3dac0c99afff9a5 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841984.929471:0:15006:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006b36cf69/0xe3dac0c99afff99e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6d30 expref: 8 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841984.929480:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787841984.929485:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787841984.929490:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000044d0f2cc/0xe3dac0c99afff9a5 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841984.929528:0:15006:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006b36cf69/0xe3dac0c99afff99e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6d30 expref: 8 pid: 15007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841984.929543:0:15006:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006b36cf69/0xe3dac0c99afff99e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6d30 expref: 8 pid: 15007 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841984.929557:0:15006:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbc3dcf0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:15006:1874687715032192:192.168.201.1@tcp:104: 00000100:00100000:2.0:1787841984.929643:0:15006:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc63e4d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787841984.937289:0:15006:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbc3dcf0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:15006:1874687715032192:192.168.201.1@tcp:104: 00010000:00010000:2.0:1787841984.937338:0:15006:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000044d0f2cc/0xe3dac0c99afff9a5 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841984.946888:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841984.946992:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695127296 00000100:00100000:1.0:1787841984.947002:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695127296 00010000:00010000:1.0:1787841984.947044:0:14308:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006b36cf69/0xe3dac0c99afff99e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6d30 expref: 9 pid: 15007 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787841984.947088:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 15 00000100:00100000:1.0:1787841984.947098:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff4d70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d29cd7d6-5033-4a84-a074-c74886c050cd+9:2356:x1874687695127296:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787841984.947115:0:14308:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787841984.947139:0:14308:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006b36cf69/0xe3dac0c99afff99e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6d30 expref: 9 pid: 15007 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841984.947164:0:14308:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006b36cf69/0xe3dac0c99afff99e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6d30 expref: 9 pid: 15007 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841984.947190:0:14308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b36cf69/0xe3dac0c99afff99e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6d30 expref: 9 pid: 15007 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841984.947208:0:14308:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787841984.947212:0:14308:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787841984.947218:0:14308:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000044d0f2cc/0xe3dac0c99afff9a5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841984.947230:0:14308:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000044d0f2cc/0xe3dac0c99afff9a5 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841984.947281:0:14308:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787841984.947337:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff4d70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d29cd7d6-5033-4a84-a074-c74886c050cd+8:2356:x1874687695127296:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 240us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841984.947345:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 15 00010000:00010000:2.0:1787841984.947416:0:15006:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000044d0f2cc/0xe3dac0c99afff9a5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841984.947426:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000044d0f2cc/0xe3dac0c99afff9a5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841984.947450:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000044d0f2cc/0xe3dac0c99afff9a5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841984.947459:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000044d0f2cc/0xe3dac0c99afff9a5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841984.947468:0:15006:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000044d0f2cc/0xe3dac0c99afff9a5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841984.947476:0:15006:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6104e00 already unused, calling callback (ffffffffc17a4500) 00010000:00010000:2.0:1787841984.947481:0:15006:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000044d0f2cc/0xe3dac0c99afff9a5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841984.947489:0:15006:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000044d0f2cc/0xe3dac0c99afff9a5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841984.947501:0:15006:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000044d0f2cc/0xe3dac0c99afff9a5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841984.947517:0:15006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000044d0f2cc/0xe3dac0c99afff9a5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841984.947562:0:15006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cac11170c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d29cd7d6-5033-4a84-a074-c74886c050cd+7:2357:x1874687695127168:12345-192.168.201.1@tcp:1:lhsmtool_posix.0 Request processed in 18164us (18369us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841984.947570:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 19 00000100:00100000:1.0:1787841984.962471:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841984.962568:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695127552 00000100:00100000:3.0:1787841984.962578:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695127552 00000100:00100000:3.0:1787841984.962648:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 60 00000100:00100000:3.0:1787841984.962658:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e2f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d29cd7d6-5033-4a84-a074-c74886c050cd+13:14545:x1874687695127552:12345-192.168.201.1@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787841984.962786:0:14323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9ca00/0xe3dac0c99afff9ac lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841984.962817:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9ca00/0xe3dac0c99afff9ac lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841984.962830:0:14323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9ca00/0xe3dac0c99afff9ac lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841984.963093:0:14323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99afff9b3 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841984.963105:0:14323:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725a00/0xe3dac0c99afff97b lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6d1b expref: 14 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841984.963113:0:14323:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99afff9b3 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841984.963146:0:14323:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725a00/0xe3dac0c99afff97b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6d1b expref: 14 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841984.963161:0:14323:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725a00/0xe3dac0c99afff97b lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6d1b expref: 14 pid: 14324 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787841984.963176:0:14323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbc9547c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14323:1874687715032320:192.168.201.1@tcp:104: 00000100:00100000:3.0:1787841984.963247:0:14323:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc4ef8480 going to sleep for 11 seconds 00000100:00100000:3.0:1787841984.970549:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:1.0:1787841984.974819:0:14323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbc9547c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14323:1874687715032320:192.168.201.1@tcp:104: 00010000:00010000:1.0:1787841984.974860:0:14323:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99afff9b3 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841984.975876:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695127680 00000100:00100000:0.0:1787841984.975893:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695127680 00010000:00010000:0.0:1787841984.975937:0:14307:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725a00/0xe3dac0c99afff97b lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6d1b expref: 15 pid: 14324 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787841984.975972:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 16 00000100:00100000:0.0:1787841984.975997:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbc95452c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d29cd7d6-5033-4a84-a074-c74886c050cd+15:2357:x1874687695127680:12345-192.168.201.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787841984.976013:0:14307:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787841984.976019:0:14307:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725a00/0xe3dac0c99afff97b lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6d1b expref: 15 pid: 14324 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841984.976033:0:14307:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725a00/0xe3dac0c99afff97b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6d1b expref: 15 pid: 14324 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841984.976055:0:14307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6725a00/0xe3dac0c99afff97b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6d1b expref: 15 pid: 14324 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841984.976070:0:14307:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff92cbc89cd800) 00010000:00010000:0.0:1787841984.976075:0:14307:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99afff9b3 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841984.976084:0:14307:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99afff9b3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841984.976092:0:14307:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99afff9b3 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787841984.976211:0:14307:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787841984.976273:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbc95452c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d29cd7d6-5033-4a84-a074-c74886c050cd+14:2357:x1874687695127680:12345-192.168.201.1@tcp:103:ldlm_bl.0 Request processed in 276us (5731us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841984.976280:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 16 00010000:00010000:3.0:1787841984.980483:0:14323:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99afff9b3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841984.980500:0:14323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99afff9b3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787841984.980997:0:14323:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:3.0:1787841984.981323:0:14323:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000001:00080000:3.0:1787841984.981373:0:14323:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934626 00000100:00100000:3.0:1787841984.981465:0:14323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbc9546d00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14323:1874687715032448:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787841984.981533:0:14323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841984.981643:0:14323:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbd5b88780 going to sleep for 11 seconds 00000100:00100000:2.0:1787841984.987110:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715032448 00000100:00100000:2.0:1787841984.987126:0:14327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715032448 00000100:00100000:2.0:1787841984.987225:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787841984.987237:0:14327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbc95443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14323:x1874687715032448:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787841984.987372:0:14327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbc95443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14323:x1874687715032448:12345-0@lo:1000:mdt00_001.0 Request processed in 137us (5838us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841984.987380:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787841984.987451:0:14323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbc9546d00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14323:1874687715032448:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1787841984.988211:0:14323:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934627 00000100:00100000:3.0:1787841984.988294:0:14323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbc9546d00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14323:1874687715032576:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787841984.988355:0:14323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841984.991399:0:14323:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc38963c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787841984.998063:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715032576 00000100:00100000:0.0:1787841984.998084:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715032576 00000100:00100000:0.0:1787841984.998376:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787841984.998390:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbc9544b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:14323:x1874687715032576:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787841984.999567:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbc9544b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:14323:x1874687715032576:12345-0@lo:1000:mdt00_001.0 Request processed in 1174us (11203us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1787841984.999579:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787841985.002968:0:14323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbc9546d00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14323:1874687715032576:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1787841985.003028:0:14323:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99afff9b3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841985.003040:0:14323:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99afff9b3 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841985.003048:0:14323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99afff9b3 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841985.003054:0:14323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cc00d9de00 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:2.0:1787841985.003058:0:14323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99afff9b3 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841985.003088:0:14323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99afff9b3 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841985.003106:0:14323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff92cbc89cd800) 00010000:00010000:2.0:1787841985.003109:0:14323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787841985.003114:0:14323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99afff9b3 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841985.003120:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9de00/0xe3dac0c99afff9b3 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841985.003167:0:14323:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149ce00/0xe3dac0c99afff90b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841985.003175:0:14323:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149ce00/0xe3dac0c99afff90b lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841985.003180:0:14323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149ce00/0xe3dac0c99afff90b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841985.003185:0:14323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc149ce00 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:2.0:1787841985.003188:0:14323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149ce00/0xe3dac0c99afff90b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841985.003194:0:14323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149ce00/0xe3dac0c99afff90b lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841985.003202:0:14323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff92cbc89cd200) 00010000:00010000:2.0:1787841985.003204:0:14323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787841985.003212:0:14323:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3330a00/0xe3dac0c99afff912 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6cff expref: 17 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841985.003234:0:14323:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3330a00/0xe3dac0c99afff912 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6cff expref: 17 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841985.003243:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3330a00/0xe3dac0c99afff912 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6cff expref: 17 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841985.003281:0:14323:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff92cac3330a00/0xe3dac0c99afff912 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6cff expref: 17 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841985.003297:0:14323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbc3dcf0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14323:1874687715032704:192.168.201.1@tcp:105: 00000100:00100000:2.0:1787841985.003394:0:14323:0:(client.c:2715:ptlrpc_set_wait()) set ffff92cbc63e4d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787841985.009081:0:14323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbc3dcf0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14323:1874687715032704:192.168.201.1@tcp:105: 00010000:00010000:2.0:1787841985.009116:0:14323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149ce00/0xe3dac0c99afff90b lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841985.009127:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc149ce00/0xe3dac0c99afff90b lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841985.009178:0:14323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104400/0xe3dac0c99afff9ba lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841985.009192:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104400/0xe3dac0c99afff9ba lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841985.009204:0:14323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104400/0xe3dac0c99afff9ba lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841985.009215:0:14323:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104400/0xe3dac0c99afff9ba lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841985.009236:0:14323:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104400/0xe3dac0c99afff9ba lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841985.009243:0:14323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104400/0xe3dac0c99afff9ba lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841985.009249:0:14323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6104400 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:2.0:1787841985.009255:0:14323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104400/0xe3dac0c99afff9ba lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841985.009261:0:14323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104400/0xe3dac0c99afff9ba lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841985.009273:0:14323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff92cbc89cd200) 00010000:00010000:2.0:1787841985.009276:0:14323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787841985.009280:0:14323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104400/0xe3dac0c99afff9ba lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841985.009286:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104400/0xe3dac0c99afff9ba lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841985.009297:0:14323:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9ca00/0xe3dac0c99afff9ac lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841985.009303:0:14323:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9ca00/0xe3dac0c99afff9ac lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841985.009310:0:14323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9ca00/0xe3dac0c99afff9ac lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841985.009315:0:14323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cc00d9ca00 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:2.0:1787841985.009325:0:14323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9ca00/0xe3dac0c99afff9ac lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841985.009331:0:14323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9ca00/0xe3dac0c99afff9ac lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841985.009340:0:14323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff92cbc89cd200) 00010000:00010000:2.0:1787841985.009342:0:14323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787841985.009345:0:14323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9ca00/0xe3dac0c99afff9ac lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841985.009350:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9ca00/0xe3dac0c99afff9ac lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841985.009633:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e2f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d29cd7d6-5033-4a84-a074-c74886c050cd+17:14545:x1874687695127552:12345-192.168.201.1@tcp:57:lhsmtool_posix.0 Request processed in 46974us (47172us total) trans 8589934628 rc 0/0 00000100:00100000:2.0:1787841985.009643:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 60 00000020:00080000:2.0:1787841985.009648:0:14323:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1787841985.010316:0:14354:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787841985.010323:0:14354:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787841985.010353:0:14354:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1787841985.010359:0:14354:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1787841985.015572:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841985.015667:0:16555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695127936 00000100:00100000:3.0:1787841985.015678:0:16555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695127936 00000100:00100000:3.0:1787841985.015792:0:16555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 12 00000100:00100000:3.0:1787841985.015803:0:16555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff4d5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d29cd7d6-5033-4a84-a074-c74886c050cd+17:14545:x1874687695127936:12345-192.168.201.1@tcp:35:lhsmtool_posix.0 00000100:00080000:1.0:1787841985.016054:0:14318:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:3.0:1787841985.020118:0:16555:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787841985.020270:0:16555:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934629 00010000:00010000:3.0:1787841985.020341:0:16555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9da00/0xe3dac0c99afff9c1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841985.020361:0:16555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9da00/0xe3dac0c99afff9c1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 16555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841985.020373:0:16555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9da00/0xe3dac0c99afff9c1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 16555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841985.020381:0:16555:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9da00/0xe3dac0c99afff9c1 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 16555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841985.020393:0:16555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9da00/0xe3dac0c99afff9c1 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 16555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841985.020399:0:16555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9da00/0xe3dac0c99afff9c1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 16555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841985.022092:0:16555:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787841985.022457:0:16555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff4d5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d29cd7d6-5033-4a84-a074-c74886c050cd+19:14545:x1874687695127936:12345-192.168.201.1@tcp:35:lhsmtool_posix.0 Request processed in 6649us (6890us total) trans 8589934630 rc 0/0 00000100:00100000:3.0:1787841985.022469:0:16555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 12 00000020:00080000:3.0:1787841985.022476:0:16555:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787841985.022796:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841985.023206:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695128064 00000100:00100000:3.0:1787841985.023216:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695128064 00000100:00100000:3.0:1787841985.023289:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 13 00000100:00100000:3.0:1787841985.023299:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e652c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d29cd7d6-5033-4a84-a074-c74886c050cd+19:14544:x1874687695128064:12345-192.168.201.1@tcp:49:bash.0 00000100:00100000:3.0:1787841985.023406:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e652c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d29cd7d6-5033-4a84-a074-c74886c050cd+19:14544:x1874687695128064:12345-192.168.201.1@tcp:49:bash.0 Request processed in 108us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841985.023413:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 13 00010000:00010000:1.0:1787841985.025589:0:14311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787841985.025603:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9da00/0xe3dac0c99afff9c1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 16555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841985.025625:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cc00d9da00 already unused, calling callback (ffffffffc17a4500) 00010000:00010000:1.0:1787841985.025629:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9da00/0xe3dac0c99afff9c1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 16555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841985.025639:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9da00/0xe3dac0c99afff9c1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 16555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841985.025657:0:14311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff92cbc89cd800) 00010000:00010000:1.0:1787841985.025660:0:14311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787841985.025685:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9da00/0xe3dac0c99afff9c1 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 16555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841985.025691:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9da00/0xe3dac0c99afff9c1 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 16555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787841985.025854:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841985.025856:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787841985.025858:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787841985.050215:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841985.050264:0:15005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695128192 00000100:00100000:3.0:1787841985.050274:0:15005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695128192 00000100:00100000:3.0:1787841985.050341:0:15005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 20 00000100:00100000:3.0:1787841985.050352:0:15005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e64b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d29cd7d6-5033-4a84-a074-c74886c050cd+7:14544:x1874687695128192:12345-192.168.201.1@tcp:101:bash.0 00010000:00010000:3.0:1787841985.050372:0:15005:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841985.050400:0:15005:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f8f7d18b/0xe3dac0c99afff9c8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6d37 expref: -99 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787841985.050427:0:15005:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a904dc0, atime: 0x6a904dbe, ctime: 0x6a904dc0, blocks: 0x1 00010000:00010000:3.0:1787841985.050464:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=525s v=(0 0) 00010000:00010000:3.0:1787841985.050469:0:15005:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787841985.050479:0:15005:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f8f7d18b/0xe3dac0c99afff9c8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6d37 expref: 8 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841985.050499:0:15005:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f8f7d18b/0xe3dac0c99afff9c8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6d37 expref: 8 pid: 15005 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841985.050512:0:15005:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cc00d9d400, rc 0) 00000100:00100000:3.0:1787841985.050576:0:15005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e64b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d29cd7d6-5033-4a84-a074-c74886c050cd+8:14544:x1874687695128192:12345-192.168.201.1@tcp:101:bash.0 Request processed in 227us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841985.050583:0:15005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 20 00000100:00100000:3.0:1787841985.058159:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841985.058272:0:16555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695128448 00000100:00100000:0.0:1787841985.058284:0:16555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695128448 00000100:00100000:0.0:1787841985.058342:0:16555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 14 00000100:00100000:0.0:1787841985.058352:0:16555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbc9544000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d29cd7d6-5033-4a84-a074-c74886c050cd+19:14544:x1874687695128448:12345-192.168.201.1@tcp:35:bash.0 00000001:00080000:0.0:1787841985.058654:0:16555:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934631 00000001:00080000:0.0:1787841985.058798:0:16555:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934632 00000100:00100000:0.0:1787841985.058931:0:16555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbc9544000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d29cd7d6-5033-4a84-a074-c74886c050cd+22:14544:x1874687695128448:12345-192.168.201.1@tcp:35:bash.0 Request processed in 578us (791us total) trans 8589934633 rc 0/0 00000100:00100000:0.0:1787841985.058939:0:16555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 14 00000020:00080000:0.0:1787841985.058944:0:16555:0:(tgt_main.c:785:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:0.0:1787841985.162398:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787841985.242540:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841985.242636:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695128704 00000100:00100000:3.0:1787841985.242646:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695128704 00000100:00100000:3.0:1787841985.242745:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 61 00000100:00100000:3.0:1787841985.242756:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbc3dcf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d29cd7d6-5033-4a84-a074-c74886c050cd+22:14555:x1874687695128704:12345-192.168.201.1@tcp:101:lfs.0 00010000:00010000:3.0:1787841985.242779:0:14324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787841985.242798:0:14324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99afff9cf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd625126d5f7d6d3e expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787841985.243081:0:14324:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1787841985.244354:0:14324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99afff9cf lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6d3e expref: 24 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841985.244372:0:14324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92cbc57e3500) 00010000:00010000:3.0:1787841985.244375:0:14324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787841985.244394:0:14324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cc00d9d600/0xe3dac0c99afff9cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.1@tcp remote: 0xd625126d5f7d6d3e expref: 24 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787841985.244409:0:14324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92cc00d9d600, rc 0) 00000100:00100000:3.0:1787841985.244549:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbc3dcf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d29cd7d6-5033-4a84-a074-c74886c050cd+23:14555:x1874687695128704:12345-192.168.201.1@tcp:101:lfs.0 Request processed in 1792us (2016us total) trans 8589934634 rc 301/301 00000100:00100000:3.0:1787841985.244558:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 61 00000100:00100000:1.0:1787841985.265361:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841985.265540:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695128832 00000100:00100000:2.0:1787841985.265550:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695128832 00000100:00100000:2.0:1787841985.265612:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 62 00000100:00100000:2.0:1787841985.265621:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6c6ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d29cd7d6-5033-4a84-a074-c74886c050cd+23:14555:x1874687695128832:12345-192.168.201.1@tcp:34:lfs.0 00010000:00010000:2.0:1787841985.265938:0:14323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104000/0xe3dac0c99afff9dd lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841985.265957:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104000/0xe3dac0c99afff9dd lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841985.265971:0:14323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104000/0xe3dac0c99afff9dd lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841985.266003:0:14323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105400/0xe3dac0c99afff9e4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841985.266011:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105400/0xe3dac0c99afff9e4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841985.266030:0:14323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105400/0xe3dac0c99afff9e4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841985.266449:0:14323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104600/0xe3dac0c99afff9eb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841985.266458:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104600/0xe3dac0c99afff9eb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841985.266465:0:14323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104600/0xe3dac0c99afff9eb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787841985.266505:0:14323:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104600/0xe3dac0c99afff9eb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841985.266518:0:14323:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104000/0xe3dac0c99afff9dd lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841985.266524:0:14323:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104000/0xe3dac0c99afff9dd lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841985.266531:0:14323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104000/0xe3dac0c99afff9dd lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841985.266536:0:14323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6104000 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:2.0:1787841985.266540:0:14323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104000/0xe3dac0c99afff9dd lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841985.266553:0:14323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104000/0xe3dac0c99afff9dd lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841985.266565:0:14323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff92cbc3b04400) 00010000:00010000:2.0:1787841985.266568:0:14323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787841985.266573:0:14323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104000/0xe3dac0c99afff9dd lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841985.266578:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104000/0xe3dac0c99afff9dd lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841985.266590:0:14323:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105400/0xe3dac0c99afff9e4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841985.266596:0:14323:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105400/0xe3dac0c99afff9e4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841985.266601:0:14323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105400/0xe3dac0c99afff9e4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841985.266606:0:14323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6105400 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:2.0:1787841985.266609:0:14323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105400/0xe3dac0c99afff9e4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841985.266615:0:14323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105400/0xe3dac0c99afff9e4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841985.266620:0:14323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff92cbc3b04600) 00010000:00010000:2.0:1787841985.266623:0:14323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787841985.266625:0:14323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105400/0xe3dac0c99afff9e4 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841985.266642:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6105400/0xe3dac0c99afff9e4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841985.266658:0:14323:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104600/0xe3dac0c99afff9eb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841985.266837:0:14323:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104600/0xe3dac0c99afff9eb lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841985.266845:0:14323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104600/0xe3dac0c99afff9eb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841985.266851:0:14323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92cbc6104600 already unused, calling callback (ffffffffc21c24f0) 00010000:00010000:2.0:1787841985.266853:0:14323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104600/0xe3dac0c99afff9eb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841985.266859:0:14323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104600/0xe3dac0c99afff9eb lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841985.266867:0:14323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff92cbc89cd200) 00010000:00010000:2.0:1787841985.266869:0:14323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787841985.266873:0:14323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104600/0xe3dac0c99afff9eb lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787841985.266879:0:14323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92cbc6104600/0xe3dac0c99afff9eb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14323 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787841985.267029:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6c6ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d29cd7d6-5033-4a84-a074-c74886c050cd+23:14555:x1874687695128832:12345-192.168.201.1@tcp:34:lfs.0 Request processed in 1406us (1676us total) trans 0 rc 0/0 00000100:00100000:2.0:1787841985.267038:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 62 00000100:00100000:2.0:1787841985.273381:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:0.0:1787841985.273484:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695129088 00000100:00100000:0.0:1787841985.273495:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695129088 00000100:00100000:0.0:1787841985.273561:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 15 00000100:00100000:0.0:1787841985.273570:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbc3dcd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d29cd7d6-5033-4a84-a074-c74886c050cd+23:14555:x1874687695129088:12345-192.168.201.1@tcp:35:lfs.0 00000100:00100000:2.0:1787841985.281263:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbc9547480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874687715032960:0@lo:400:kworker.0 00000100:00100000:2.0:1787841985.281348:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841985.281412:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbc95461c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1874687715033216:0@lo:400:kworker.0 00000100:00100000:3.0:1787841985.281446:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841985.281519:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787841985.281525:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbc9546940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874687715033088:0@lo:400:kworker.0 00000100:00100000:3.0:1787841985.281547:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787841985.281573:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715033216 00000100:00100000:3.0:1787841985.281579:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715033216 00000100:00100000:0.0:1787841985.283661:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbc95470c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:3298:1874687715032832:0@lo:400:kworker.0 00000100:00100000:0.0:1787841985.283764:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841985.283814:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbc9547c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1874687715033344:0@lo:400:kworker.0 00000100:00100000:0.0:1787841985.283855:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787841985.283901:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715032832 00000100:00100000:0.0:1787841985.283922:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715032832 00000100:00100000:0.0:1787841985.283972:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1787841985.283981:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbe7e2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+19:3298:x1874687715032832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841985.284033:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbe7e2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5c21f71-9ee1-4aef-b035-d0eddff43cd3+19:3298:x1874687715032832:12345-0@lo:400:kworker.0 Request processed in 53us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841985.284040:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1787841985.284086:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715033088 00000100:00100000:0.0:1787841985.284091:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715033088 00000100:00100000:0.0:1787841985.284110:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715033344 00000100:00100000:0.0:1787841985.284113:0:14322:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715033344 00000100:00100000:1.0:1787841985.284658:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbc3dcd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d29cd7d6-5033-4a84-a074-c74886c050cd+24:14555:x1874687695129088:12345-192.168.201.1@tcp:35:lfs.0 Request processed in 11085us (11282us total) trans 8589934635 rc 0/0 00000100:00100000:1.0:1787841985.284668:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 15 00000100:00100000:1.0:1787841985.284913:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbc95470c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a5c21f71-9ee1-4aef-b035-d0eddff43cd3:3298:1874687715032832:0@lo:400:kworker.0 00000100:00100000:1.0:1787841985.284929:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787841985.284938:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6c6a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687715033472:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787841985.284973:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841985.285006:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715033472 00000100:00100000:1.0:1787841985.285010:0:15010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715033472 00000100:00100000:1.0:1787841985.285056:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787841985.285064:0:15010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6c68f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3298:x1874687715033472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787841985.285093:0:15010:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787841985.285127:0:15010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6c68f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3298:x1874687715033472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841985.285133:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787841985.285171:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6c6a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1874687715033472:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787841985.285204:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787841985.285212:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff3ebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874687715033088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841985.285265:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff3ebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874687715033088:12345-0@lo:400:kworker.0 Request processed in 54us (3716us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841985.285271:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787841985.292081:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715032960 00000100:00100000:1.0:1787841985.292096:0:15007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715032960 00000100:00100000:3.0:1787841985.292301:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbc9546940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874687715033088:0@lo:400:kworker.0 00000100:00100000:3.0:1787841985.292392:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787841985.292401:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff3eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874687715033216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787841985.292480:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff3eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874687715033216:12345-0@lo:400:kworker.0 Request processed in 80us (11033us total) trans 0 rc 0/0 00000100:00100000:3.0:1787841985.292486:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787841985.292517:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbc95461c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1874687715033216:0@lo:400:kworker.0 00000100:00100000:0.0:1787841985.299598:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787841985.299615:0:14322:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf6e67840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1874687715033344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787841985.299746:0:14322:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf6e67840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1874687715033344:12345-0@lo:400:kworker.0 Request processed in 136us (15890us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841985.299754:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787841985.299840:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbc9547c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1874687715033344:0@lo:400:kworker.0 00000100:00100000:1.0:1787841985.300165:0:15007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787841985.300177:0:15007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbc3dcc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1874687715032960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787841985.300228:0:15007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbc3dcc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1874687715032960:12345-0@lo:400:kworker.0 Request processed in 53us (18879us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841985.300234:0:15007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787841985.300309:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbc9547480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1874687715032960:0@lo:400:kworker.0 00000100:00080000:2.0:1787841985.300386:0:14318:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787841985.300392:0:14318:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:0.0:1787841985.847375:0:7643:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00000001:00080000:0.0:1787841985.847397:0:7643:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934596 is committed 00010000:00010000:1.0:1787841986.177250:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787841987.201028:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787841987.513771:0:16596:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: /mnt/lustre/d1c.sanity-pcc/f1c.sanity-pcc expected pcc state: readwrite, but got: none 00000100:00100000:2.0:1787841987.739460:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:2.0:1787841987.739540:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.1@tcp (source: 12345-192.168.201.1@tcp) 00000100:00100000:3.0:1787841987.739642:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695129216 00000100:00100000:3.0:1787841987.739653:0:15011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695129216 00002000:00100000:3.0:1787841987.739731:0:15011:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x22:0x0] (0->8) req@ffff92cbc3dce1c0 x1874687695129216/t0(0) o4->d29cd7d6-5033-4a84-a074-c74886c050cd@192.168.201.1@tcp:488/0 lens 504/0 e 0 to 0 dl 1787841998 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:3.0:1787841987.739761:0:15011:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff92cbc3dce1c0 with x1874687695129216 ext(0->8) 00002000:00010000:3.0:1787841987.739767:0:15011:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92cbc3dce1c0 00000100:00100000:3.0:1787841987.739808:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 0 00000100:00100000:3.0:1787841987.739822:0:15011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbc3dce1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d29cd7d6-5033-4a84-a074-c74886c050cd+6:2356:x1874687695129216:12345-192.168.201.1@tcp:4:bash.0 00000100:00080000:2.0:1787841987.739848:0:14318:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787841987.740513:0:15011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbc3dce1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d29cd7d6-5033-4a84-a074-c74886c050cd+8:2356:x1874687695129216:12345-192.168.201.1@tcp:4:bash.0 Request processed in 690us (970us total) trans 8589934598 rc 0/0 00000100:00100000:3.0:1787841987.740523:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 0 00002000:00100000:3.0:1787841987.740531:0:15011:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x22:0x0] (0->8) req@ffff92cbc3dce1c0 x1874687695129216/t8589934598(0) o4->d29cd7d6-5033-4a84-a074-c74886c050cd@192.168.201.1@tcp:488/0 lens 504/448 e 0 to 0 dl 1787841998 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:3.0:1787841987.740540:0:15011:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff92cbc3dce1c0 with x1874687695129216 ext(0->8) 00002000:00010000:3.0:1787841987.740544:0:15011:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92cbc3dce1c0 00000100:00100000:0.0:1787841987.742849:0:16199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687695129344 00000100:00100000:0.0:1787841987.742999:0:16199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687695129344 00000100:00100000:1.0:1787841987.743114:0:16199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.1@tcp, seq: 21 00000100:00100000:1.0:1787841987.743125:0:16199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbf7e9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d29cd7d6-5033-4a84-a074-c74886c050cd+8:2356:x1874687695129344:12345-192.168.201.1@tcp:16:kworker.0 00000001:00080000:1.0:1787841987.826065:0:7643:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00000100:00100000:0.0:1787841987.826461:0:16199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbf7e9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d29cd7d6-5033-4a84-a074-c74886c050cd+6:2356:x1874687695129344:12345-192.168.201.1@tcp:16:kworker.0 Request processed in 83331us (87003us total) trans 0 rc 0/0 00000100:00100000:0.0:1787841987.826474:0:16199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.1@tcp, seq: 21 00010000:00010000:1.0:1787841988.225667:0:14311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787841988.354510:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787841988.354534:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92cbf6e65680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874687715033600:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787841988.354604:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787841988.354729:0:15010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874687715033600 00000100:00100000:1.0:1787841988.354737:0:15010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874687715033600 00000100:00100000:1.0:1787841988.354816:0:15010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787841988.354825:0:15010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92cbff3e9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874687715033600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787841988.354860:0:15010:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787841988.354920:0:15010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92cbff3e9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874687715033600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1787841988.354928:0:15010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1787841988.355794:0:14318:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787841988.355844:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92cbf6e65680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1874687715033600:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787841989.250749:0:14310:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 30303 lines, 30303 kept, 0 dropped, 0 bad.